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Honorable Assistant Commissioner for Patents 
Washington, D.C. 20231 

Dear Sir: 

Before examining the above-captioned divisional application, please enter the following 
amendment. 
In the Claims : 

B. Please add Claim 1 16-125 as follows : 

-116. A method for forming an extended field of view of a target, said method 
comprising the following steps: 
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(a) acquiring a plurality of sets of image information with an ultrasonic 
transducer array, said array moved substantially in an image plane between sets of image 
information; 

(b) determining a component of motion in the image plane based on a 
comparison of image information from a first one of said sets with a second one of said sets 
and a search area; 

(c) adaptively changing a center of the search area within the second one 
of said sets as a function of a previous motion estimate for step (b); 

(d) registering said first and second sets as a function of the component of 

motion; and 

(e) forming an extended field of view image as a function of the 
registration of step (d). 

117. The method of Claim 116 further comprising step (f) of adaptively changing a 
size of the search area as a function of the previous motion estimate. 

118. A method for forming an extended field of view of a target, said method 
comprising the following steps: 

(a) acquiring a plurality of sets of image information with an ultrasonic 
transducer array, said array moved substantially in an image plane between sets of image 
information; 

(b) gating step (a); 

(c) determining a component of motion in the image plane based on a 
comparison of image information from a first one of said sets with a second one of said sets, 
the first and second ones of said sets corresponding to a portion of a cycle as a function of 
the gating of step (b); 

(d) registering said first and second sets as a function of the component of 

motion; and 

(e) forming an extended field of view image as a function of the 
registration of step (d). 
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1 19. The method of Claim 118 wherein step (b) comprises gating to an ECG cycle. 

120. The method of Claim 1 1 8 wherein step (b) comprises gating to a breathing 

cycle. 

121. A method for forming an extended field of view of a target, said method 
comprising the following steps: 

(a) acquiring a plurality of sets of image information with an ultrasonic 
transducer array, said array moved substantially in an image plane between sets of image 
information; 

(b) compressing the sets of image information; 

(c) transferring the compressed sets of image information to a motion 
estimation computer; 

(d) determining a component of motion in the image plane based on a 
comparison of image information from a first one of said sets with a second one of said sets 
with the motion estimation computer; 

(e) registering said first and second sets as a function of the component of 

motion; and 

(f) forming an extended field of view image as a function of the 
registration of step (e). 

122. The method of Claim 121 further comprising step (g) of decompressing the 
sets of image information after step (c). 

123. The method of Claim 121 wherein step (c) comprises transferring to a remote 

site. 

124. A method for forming an extended field of view of a target, said method 
comprising the following steps: 
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(a) acquiring a plurality of sets of image information with an ultrasonic 
transducer array, said array moved substantially in an image plane between sets of image 
information; 

(b) comparing image information from a first one of said sets with a 
second one of said sets; 

(c) determining a component of motion with sub-pixel resolution in the 

image plane; 

(d) registering said first and second sets as a function of the component of 

motion; and 

(e) forming an extended field of view image as a function of the 
registration of step (d). 

125. The method of Claim 124 further comprising: 

(f) determining at least a minimum and two neighboring values associated 
with motion; and 

wherein step (c) comprises determining the component of motion with sub- 
pixel resolution in the image plane as a function of the minimum and two neighboring 
values. ~ 

Please cancel claim 1. 

Remarks 

Claims 1 16-125 correspond to claims 1 17-126 in the parent application 09/340,542. 
The parent claims 1 17-126 were subject to a restriction requirement for four different groups 
corresponding to the four independent claims. Applicant respectfully submits that the claims of 
these groups may be efficiently searched together. Applicants respectfully submit that all of the 
pending claims are in condition for allowance and seeks early allowance thereof. If for any 
reason, the Examiner is unable to allow the application in the next Office Action and believes 
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that an interview would be helpful to resolve any remaining issues, he is respectfully requested 
to contact the undersigned attorneys at (312) 321-4200. 



BRINKS HOFER GILSON & LIONE 
P.O. BOX 10395 
CHICAGO, ILLINOIS 60610 
(312) 321-4726 

Dated: September 26, 2000 



Respectfully submitted, 




Craj/A. Sumrnerfield ~ 
Registration No. 37,^947 
Attorney for Applicant 



5 



Our Case No. 5050/204 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 
APPLICATION FOR UNITED STATES LETTERS PATENT 



INVENTOR: 



John A. Hossack 
John W. Sliwa, Jr. 
Samuel H. Maslak 
Edward A. Gardner 
Gregory L. Holley 
David J. Napolitano 



TITLE: 



MULTIPLE ULTRASOUND IMAGE 
REGISTRATION SYSTEM, 
METHOD AND TRANSDUCER 



ATTORNEY: William A. Webb 

BRINKS HOFER GILSON & LIONE 
P.O. BOX 10395 
CHICAGO, ILLINOIS 60610 
(312) 321-4218 



1 

MULTIPLE ULTRASOUND IMAGE REGISTRATION 
SYSTEM, METHOD AND TRANSDUCER 

CROSS-REFERENCE TO RELATED APPLICATION 

This application is a continuation-in-part of co-pending U.S. patent 
application Serial No. 08/621,561, filed March 25, 1996, which is in turn a 
continuation-in-part of provisional U.S. patent application Serial No, 
60/01-2,578 filed February 29, 1996, and assigned to the assignee of the 
present invention. 

BACKGROUND OF THE INVENTION 

This invention relates to an improved system, method and transducer 
for acquiring two-dimensional image information and relative positional 
information regarding the image information to allow subsequent three- 
dimensional or extended field of view reconstruction. 

There is growing interest in three-dimensional ultrasonic images. One 
approach is to use a two-dimensional transducer array to obtain three- 
dimensional image information directly. A two-dimensional array can be used 
to scan electronically in any desired orientation, and thereby to acquire the 
desired information. This approach brings with it considerable problems 
related to fabrication difficulties, signal to noise difficulties and processing 
difficulties. 

Another approach is to collect multiple two-dimensional image data 
frames using a one-dimensional transducer array along with relative 
positional information among the image data frames so that these frames may 
be subsequently assembled in a three-dimensional volume to form the 
desired three-dimensional reconstruction. One approach is to use a 
motorized array to collect the desired set of image data frames by precisely 
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controlling the movement of the transducer array, One example is the 
transducer shown in U.S, Patent Application Serial No. 08/267,318 (Hossack, 
et al. . assigned to the assignee of the present invention). See also Pin! U.S. 
Patent No. 5,159,931 ). A related approach is to use a large rotating 
5 transducer as described in McCann et al. , "Multidimensional Ultrasonic 

Imaging for Cardiology" (Proceedings of IEEE, 76, 9, pp. 1063-1072, Sept 
1988), Another approach is to use manual motion detection techniques 
based on analysis of ultrasonic images. See Sapoznikov et aL "Left 
Ventricular Shape, Wall Thickness and Function Based on Three- 
10 Dimensional Reconstruction Echocardiography" ("Computers in Cardiology," 

IEEE Computer Society Press, Cat CH 2476-0, pp. 495-498, 1987); and 
Taruma et aL "Three-Dimensional Reconstruction of Echocardiograms 
tfj Based on Orthogonal Sections" (Pattern Recognition, 18, 2, pp. 1 15-124, 

P 1985). Manual techniques are slow and cumbersome and, therefore have 

iv 1 5 many drawbacks. 

H" Schwartz U.S. Patent 5,474,073 describes a qualitative three- 

dimensional method using a hand-held transducer array and an assumed 
[t scan motion. Qualitative methods have drawbacks, and the present invention 

^ is directed to a quantitative method. 

□20 Keller U.S. Patent 5,353,354 discloses a transducer array equipped 

with accelerometers or magnetic sensors designed to measure the orientation 
of the transducer, and therefore relative motion between respective image 
planes. Once the image plane positional information is provided, standard 
methods are employed for assembling the image plane information into a 
25 three-dimensional volume and providing an appropriate display such as a 

cross section, a surface rendering, a segmentation, or the like. One 
drawback of the Keller approach is that it relies on assessing the position of 
the transducer array with respect to a fixed surface exterior to the patient, not 
with respect to the patient or other target. If the patient moves, the absolute 
30 position of all target regions is moved, and the accuracy of the three- 

dimensional reconstruction is degraded or eliminated entirely. Magnetic 
sensor systems have additional disadvantages, such as potential vulnerability 
to local magnetic interference from metal objects and electromagnetic fields 



generated by electronic devices such as cathode ray tubes, Accelerometer 
systems can be bulky and susceptible to cumulative error, since they rely on 
two stages of integration to convert acceleration information to displacement 
information. 

The present invention is directed to a new system and transducer 
which to a large extent overcome the problems discussed above. 

SUMMARY OF THE INVENTION 

According to a first aspect of this invention, a method is provided for 
registering image information acquired from a target, comprising the following 
steps; 

(a) acquiring a plurality of sets of image information with at least 
one ultrasonic transducer array, said at least one array moved between at 
least some of the sets of image information, said plurality of sets comprising a 
plurality of image data sets and a plurality of tracking sets; 

(b) automatically determining a component of motion based on a 
comparison of at least a portion of the tracking sets acquired in step (a); and 

(c) automatically using the component of motion determined in step 
(b) to register selected ones of the image data sets acquired in step (a). 

According to one aspect of this invention, the image data sets are 
acquired with different transducer arrays. According to another aspect of this 
invention, motion estimates are used to create an extended field of view, and 
in this case no separate array may be required for the tracking sets. 

This invention is also directed to an improved transducer suitable for 
use in the method described below. The transducer of this invention includes 
a support element and first, second, and third transducer arrays coupled to 
move with the support element. The first transducer array includes first 
transducer elements arranged along an azimuthal axis and having first and 
second ends spaced along the azimuthal axis and a first central image plane. 
The second transducer array comprises second transducer elements 
positioned near the first end of the first transducer array and comprising a 
second central image plane. The third transducer array comprises third 
transducer elements positioned near the second end of the first transducer 
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array and comprising a third central image plane. The first and second 
central image planes are non-parallel, as are the first and third central image 
planes. 

This arrangement for an ultrasonic transducer allows both tracking 
information and image information to be collected concurrently. The tracking 
information is used to determine estimates of the movement of the transducer 
and/or the target between respective image data frames. This information 
can then be used in registering the respective image data frames 
appropriately in three-dimensions to form the desired three-dimensional 
representation. 

Further aspects and advantages of the invention are discussed below 
in conjunction with the preferred embodiments. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of an ultrasonic imaging system that 
incorporates a presently preferred embodiment of this invention. 

Figure 2 is a schematic perspective view of the transducer of Figure 1 . 

Figure 3 is a schematic side view of the transducer of Figure 2. 

Figure 4 is a schematic plan view of the transducer of Figure 2. 

Figure 5 is a schematic view of a portion of the system of Figure 1 . 

Figure 6 is a schematic perspective view showing the movement of 
image regions as the transducer of Figure 2 is rotated about the azimuthal 
axis. 

Figures 7, 8, 9 and 10 are schematic views showing images acquired 
with the transducer of Figure 6 at four rotational positions of the transducer. 

Figure 1 1 is a schematic perspective view showing the operation of the 
transducer of Figure 2. 

Figure 12 is a schematic plan view of a tracking image region 
generated with the system of Figure 1 . 

Figure 13 is a schematic view showing the averaging of estimates of 
motion in the system of Figure 1 . 

Figure 14 is a schematic view showing how the bulk motion of an 
imaged organ can be recognized and disregarded in the system of Figure 1. 
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Figure 15 is a schematic view showing the movement of the target 
among acoustic lines as the transducer of Figure 2 is rotated about the 
azimuthal axis. 

Figure 16 is another view of the raw acoustic line data of Figure 15. 
5 Figures 17, 18 and 19 are three schematic perspective views showing 

the manner in which multiple image data frames can be registered with 
respect to one another in three-dimensions to form a three-dimensional 
representation. 

Figure 20 is a view of a display generated by the system of Figure 1 . 
10 Figure 21 is a schematic view of a modified version of the transducer 

of Figure 1 . 

Figure 22 is a schematic view of an alternative ultrasonic imaging 
system. 

Figures 23 through 26 are plan views of transducers using crossed 
15 arrays suitable for use in selected embodiments of this invention. 

Figures 27, 27a through 27h, and 27j are plan views of alternative 
transducers suitable for use in selected embodiments of this invention. 
Figure 27i is an end view taken along line 27i-27i of Figure 27h. 
Figures 28 and 29 are plan views of other transducers suitable for use 
20 in selected embodiments of this invention. 

Figure 30 is a block diagram of an ultrasonic imaging system which 
incorporates a preferred embodiment of this invention. 

Figures 31 and 32 are flowcharts of routines performed by the imaging 
system of Figure 30. 
25 Figure 33 is a schematic diagram illustrating operation of an 

alternative embodiment. 

Figures 34 through 37 are graphs illustrating operation of a fuzzy logic 
system included in an alternative form of this invention. 

Figure 38 is a diagram showing the manner in which two frames can 
30 be weighted to form an extended field of view. 

•Figures 39 and 40 are schematic views that relate to a single block 
motion estimation system. 
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Figures 41 and 42 are schematic views of alternative systems for 
generating transmit signals. 

Figure 43 is a schematic view of a system for detecting an erroneous 
motion estimate, 

5 Detailed Description Of The 

Presently Preferred Embodiments 

Turning now to the drawings, Figure 1 is a block diagram of an 
ultrasonic imaging system 10 which incorporates a presently preferred 
embodiment of this invention. The following discussion will first present a 
10 system overview, and then a detailed description of selected components of 

the system. 

System Overview 

The system 10 includes a beamformer system/ signal detector 12 
which includes both transmit and receive beamformers and is connected via a 

15 multiplexer/ demultiplexer 14 to an ultrasonic transducer 16, Any suitable 

devices, including conventional devices, can readily be adapted for use as 
the elements 12, 14. 

The ultrasonic transducer 16 will be described in greater detail below 
in conjunction with Figures 2-4. Here, it is important to note that the 

20 transducer 16 preferably includes three separate transducer arrays 18, 20, 

22. The array 18 is used for collecting image data that will be used to 
construct displayed representations of the target. The arrays 20, 22 are 
smaller arrays oriented in this embodiment at right angles to the image data 
array 18 to operate as tracking arrays. The tracking arrays 20, 22 are used in 

25 this embodiment to estimate the motion between respective image data 

frames from the image data array to allow the image data frames to be 
registered properly for reconstruction. 

The beamformer system/signal detector 12 sends excitation signal 
pulses to the arrays 18, 20 and 22 and supplies summed returning echoes to 

30 a signal detector. The output of the signal detector is supplied to a scan 

converter 24. The beamformer system/signal detector 12 operates the arrays 
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18, 20, 22 in the conventional manner as phased arrays by properly timing 
the excitation signals applied to the arrays 18, 20, 22, and by properly timing 
and phasing the received signals prior to summing. The scan converter 24 
controls an output display 26 to display preferably the three images 
generated by the three arrays 18, 20, 22 along with additional information as 
described below. 

In addition, scan-converted image information from the scan converter 
24 is stored in a data storage system 28, In this embodiment the data 
storage system 28 includes three separate storage arrays, each storing data 
for image frames from a respective one of the arrays 18, 20, 22. Thus, image 
information from the image data transducer array 18 is stored as frames of 
image data in the storage array 30, and image information from the tracking 
transducer arrays 20 7 22 is stored as respective frames of image data in the 
storage arrays 32, 34, respectively. The frames of data in the storage arrays 
30, 32, 34 are all time marked, so that they can be associated with one 
another appropriately. This time marking can take the form of real-time clock 
information or frame number information, for example. 

The frames of image data in the storage array 30 are applied to a 
computer 36. It is these frames that are used to form the displayed 
representation of the target. The tracking image frames stored in storage 
arrays 32 and 34 are not registered to create a displayed reconstruction of 
the target, but are instead used to determine the relative positions of 
individual frames of image data from the image data storage array 30. 

In order to estimate movement of the target between successive 
frames of the image data, the image information from the tracking array data 
storage arrays 32, 34 is supplied to a motion estimator 38. The motion 
estimator 38 compares sequences of images from the tracking transducer 
array 20 and the tracking transducer array 22 to estimate a component of 
motion of the transducer 16 between the respective frames. This estimate of 
the component of motion is smoothed in logic 40, and then applied to a 
calculator 42 that calculates a vector value defining the best estimate of the 
movement between selected frames of the image data stored in the image 
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data storage array 30, This vector is then applied as another input to the 
computer 36, 

In the system 10, the elements 28 through 42 can be designed to 
operate in real time, and the motion vectors can be displayed on the output 
5 display 26 as discussed in conjunction with Figure 20. Once a full set of data 

has been acquired, the image data frames and the frame-to-frame translation 
vectors can then be transmitted to the specialized computer 36 which can 
either be combined with or external to the ultrasonic imaging system. 

The computer 36 registers selected frames of image data from the 

10 image data storage array 30 with respect to one another by appropriate use 

of the vectors supplied by the calculator 42. Also any necessary interpolation 
is done, and the respective frames of image data are stored in proper 
registration with respect to one another in a three-dimensional data storage 
device 44, The computer 36, when operating in a display mode, can select 

15 appropriate information from the three-dimensional data storage device 44 to 

provide a desired image on the display 46, For example, cross sections can 
be taken in various planes, including a wide variety of planes that do not 
correspond to the planes of the image data. Also, surface renderings and 
segmentation displays can be created if desired. 

20 In one mode of operation, the transducer 16 is rotated through a 

sweep under the direct manual control of an operator, smoothly from side-to- 
side about a single axis of rotation lying along the azimuthal axis on the face 
of the image data array 1 8. The method described below can account for 
imperfections in the sweep. During three-dimensional reconstruction, the 

25 quality of the reconstruction degrades gracefully as a result of positional 

error. Distortion rather than blurriness is the result of imperfect motion 
detection. 

The Ultrasonic Transducer 16 

Figures 2-4 provide three views of the ultrasonic transducer 16. As 
30 shown in Figure 4, the three arrays 18, 20, 22 each comprise a respective set 

of transducer elements 48, 50, 52, all mounted on a common support element 
53. The transducer elements 48 are arranged along an azimuthal axis A, and 



the image data transducer array 18 defines first and second ends 54, 56, 
The tracking arrays 20, 22 are each positioned near a respective one of the 
ends 54, 56, centered on the azimuthal axis A. The transducer elements 50, 
52 are arranged along respective tracking axes T1, T2, and the tracking axes 
T1, T2 are in this preferred embodiment substantially perpendicular to the 
azimuthal axis A, The tracking arrays 20, 22 are each shorter than the image 
data array 1 8, and each has fewer transducer elements 50, 52, Each of the 
transducer elements 48 can be spaced at 1/N times the pitch of the 
transducer elements 50, 52. As shown in Figure 3, the tracking arrays 20, 22 
can be oriented to point inwardly, toward the image data array 18. 
Alternately, the tracking arrays 20, 22 can be coplanar with the array 18, to 
provide a preferred profile for the transducer 16. 

The image data array 18 can be of conventional form, such as a flat 
linear array with a cylindrical elevation focusing lens. Alternately, the array 
can be generally flat, but the transducer elements can be curved in elevation 
to focus. In this case a non-refractive filler such as a polyurethane can be 
used since a focusing lens is no longer required. Whether or not a lens is 
used, the image data array may be curved in azimuth to yield a larger field of 
view. The tracking arrays 20, 22 will typically include a lens to achieve the 
desired focus in elevation. Since the curvatures of the various lenses or 
arrays will be in differing planes, a non-refractive filler section may be formed 
on the transducer 16 to yield the preferred smooth shape. Alternately, the 
tracking arrays 20, 22 may also be curved with non-refractive windows 
formed on top of the desired shape. Both the image data array 1 8 and the 
tracking arrays 20, 22 may be phased sector, Vector®, linear or curvilinear. 
All imaging modes including B mode, color Doppler, color Doppler energy 
and the like are supported, A conventional TEE transducer such as the 
biplane V510B transducer of Acuson can be used in a two-transducer 
embodiment. 

The transducer geometry shown in Figures 3 and 4 can be used to 
obtain image planes as shown in Figure 2. The image plane 58 of the image 
data array 18 in this embodiment passes through the azimuthal axis A. 
Image data collected with the image data array 18 is positioned along scan 
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lines 64 in the image plane 58, The image planes 60, 62 of the transducer 
arrays 20, 22, respectively, are oriented transversely to the image plane 58. 
The image planes 58, 60, 62 are the central image planes of the respective 
arrays, that is the only image plane for a 1 D array and the central plane (i.e. 
the plane not steered in elevation) for a 1 .5D array. 

For the sake of simplicity, the tracking arrays 20, 22 may have 
identical transducer element pitches to that used by the image data array 18. 
This approach allows the same beamformer delays to be used for all three 
arrays 18, 20, 22. However, in many applications the tracking arrays 20, 22 
are adapted to form relatively fewer acoustic lines. This is particularly the 
case if motion detection is concentrated in the vicinity of the center line of the 
image planes 60, 62. If only a narrow field of view is required for the tracking 
arrays 20, 22 then the tracking array pitch may be coarser, for example twice 
the pitch of the image data array 18. 

By making the tracking array pitch an integer multiple of the image 
data array pitch, the same beamforming delays can be used, but with the 
appropriate channels disconnected, as shown in Figure 5. In Figure 5 the 
element-to-element pitch of the tracking array 20 is twice that of the image 
data array 18, and consecutive transducer elements 50 of the tracking array 
20 are connected to only the even or odd signal lines for the transducer 
elements 48 of the image data array 18, In the limit, each tracking array 20, 
22 may be composed of as few as two transducer elements, although this will 
limit the maximum resolution that is achievable. 

Common signal conductors can be used between the 
beamformer/signal detector 12 and the housing for the transducer 16. In the 
housing, individual signals are routed between the signal conductors and the 
transducer elements 48, 50, 52 by high voltage analog switches or 
multiplexers, such as those available from Supertex Inc., Sunnyvale, 
California and having the family designation HV2xx. 

Figures 6-1 1 are schematic views that illustrate the manner in which 
images generated by the tracking arrays 20, 22 can be used to estimate the 
movement between images generated with the image data array 18. Figure 6 
shows a perspective view for three separate positions of the transducer 16. 
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These three separate positions of the transducer 16 are obtained by rotating 
the transducer 16 about the azimuthal axis. As the image data array 18 
rotates about the azimuthal axis A, the image planes 58A, 58B, 58C rotate in 
a fan-like manner. Thus, each of the image planes 58A, 58B, 58C of Figure 6 
is disposed in a separate, respective plane of three-dimensional space. 

In contrast, the image planes 60A, 60B, 60C; 62A, 62B, 62C for each 
tracking array 20, 22 remain coplanar as the transducer 16 is rotated about 
the azimuthal axis A. The actually imaged regions within the image planes 
60A, 60B, 60C; 62A, 62B, 62C rotate about the azimuthal axis A as the 
transducer 16 rotates. In many applications, the imaged regions within the 
image planes 58A, 58B, 58C will not overlap or intersect the imaged regions 
within the image planes 60A, 60B, 60C or the imaged regions within the 
image planes 62A, 62B, 62C. This arrangement can reduce cross talk and 
other interference problems, as discussed below. 

Figures 7-1 0 show four sets of images, Each set includes an image 
66A, B, C, D from the image data array 18 and a corresponding image 68A, 
B, C, D from one of the tracking arrays 20, 22. in this case the target is a 
sphere, and the images 66, 68 intersect such that the sphere appears in both 
images 66, 68. As shown in images 66A, B, C, and D, various cross sections 
of the sphere are displayed as the transducer 16 rotates about the azimuthal 
axis. The cross sections shown in images 66A and 66D show smaller 
diameter disks taken near an edge of the sphere, and the images 66B and 
66C show larger diameter disks taken near the center of the sphere. Thus, 
the disks shown on the images 66A, B, C and D differ in diameter, in 
accordance with the moving plane of the image (see Figure 6). In contrast, 
the images 68A, B, C, and D all show disks of the same size. Because the 
plane of the images 66A, B, C, and D remains the same, as discussed above 
in conjunction with Figure 6, the disk that is displayed in these images 
remains constant in size but moves across the image plane. The location of 
the disk as it moves from one image to the next provides a measure of a 
component of motion of the transducer 16 in the image plane of the images 
68A, B, C, D. 



If the image plane of the transducer arrays 20, 22 are not 
perpendicular to the surface of the image data array 18 (for example because 
the tracking arrays 20, 22 are pointed inwardly as shown in Figure 3), it may 
be preferred to use a cosine © correction factor to take account of the 
difference between image range and physical depth perpendicular to the 
image data array 18. 

An important advantage of the transducer 16 is that it includes two 
tracking arrays 20, 22, each positioned near an adjacent end 54, 56 of the 
image data array 18, This arrangement allows compound rotations to be 
assessed. In Figure 1 1 the transducer 16 is rotated about a rotational axis 
RA oriented as shown. In Figure 1 1 the solid-line circles denote the image of 
the target at a first point in time, and the dotted-line circles denote the image 
of the target at a subsequent point in time, after rotation about the rotational 
axis RA. Note that the images move in opposite directions in the image 
planes 60, 62 in this situation. By comparing the component of motion 
determined separately from the two tracking arrays 20, 22 the actual rotation 
of the target with respect to the transducer 16 can be determined. 

If desired, the transducer 18 can include an absolute sensor for 
position, orientation, or both, such as a magnetic sensor 19 as shown in 
Figure 21 or an accelerometer. The sensor 1 9 may be used to supplement or 
back up the motion detection approach described in detail below, and may be 
of the types described in Keller U.S. Patent 5,353,354. 

The Beamformer System/Signal Detector 12 

As the transducer 16 is rotated substantially about the azimuthal 
axis A, the image data array 18 and the tracking arrays 20, 22 are 
sequentially operated. When the arrays 18, 20, 22 are individually 
addressable I the transmit beamformer in element 12 sends appropriately 
timed and phased excitation signals to the respective transducer elements 
48, 50, 52. In one embodiment a frame of data from the image data array 1 8 
is collected, and then frames of data from the tracking arrays 20, 22 are 
collected. Alternately, the transmit beamformer may alternate between the 
image data array 18 and the tracking arrays 20, 22 between individual scan 
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lines or between groups of scan lines. If the image planes of the arrays 1 8, 
20, 22 are non-intersecting, and particularly if the image data array 18 is 
excited at a different frequency than the tracking arrays, then the risk of 
cross-array interference is small. For this reason the pulse repetition rate 
(which is normally limited by the time required for ultrasonic signals to 
attenuate in the body between successive scan lines) may be increased. 

In some applications the arrays 18, 20, 22 may be connected in 
common to the transmit beamformer. Typically, the imaging requirements for 
the image data array 18 will differ substantially from those for the tracking 
arrays 20, 22. Image data quality should be maintained at a high level, but 
tracking data need only be of sufficient quality to permit reliable tracking. 
Costs may be reduced by sharing some cable conductors between the array 
18 and the arrays 20, 22. Typically, elements near the ends of the image 
data array 18 are most suitable for sharing, since they are less important than 
center elements. 

In order to reduce interference between the arrays 18, 20, 22 cable 
routing from the elements 48 of the image data array 18 to the elements 50, 
52 of the tracking arrays 20, 22 is preferably jumbled in a known 
pseudo-random manner. The element 12 uses the jumbling scheme to sort 
the beamformer delays such that one set of arrays (either the image data 
array 18 or the tracking arrays 20, 22) is operated coherently at any given 
scan line. The other set is operated incoherently because of the cable 
jumbling. The optimum jumbling scheme may be determined by routine 
experimentation. 

Cross talk may be further reduced with frequency coding and voltage 
level techniques. The tracking arrays 20, 22 may operate with a reduced 
image depth, such as a few centimeters, and therefore a high frequency such 
as 10 MHz, The image data array 18 may operate at a longer range, lower 
frequency such as 5 MHz, thereby reducing cross talk. The transducer 
elements 48, 50, 52 may be formed with thicknesses that select the 
appropriate frequencies. Also, bandpass filters may be used in the element 
12 to select the desired frequency bands for detection. 
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Voltage levels may vary between the two sets of arrays 18, 20, 22, For 
example a higher voltage may be used when the tracking arrays 20, 22 are 
selected, particularly if the tracking arrays 20, 22 require a higher voltage to 
operate effectively. In this case the tracking arrays 20, 22 emit a relatively 
small signal when the image data array 18 is selected and the voltage level is 
reduced. 

Figure 22 shows an alternative system 10' which uses many of the 
same components as the system 10. The system 10' differs in that the arrays 
18, 20, 22 are operated simultaneously at different frequencies by 
beamformer/signal detectors 12', 12". In each case a respective bandpass 
filter 13', 13" is provided to isolate the bandpass of interest. As described 
above, the tracking arrays 20, 22 may operate at 10 MHz and the image data 
array 18 may operate at 5 MHz. The jumbled cable routing discussed above 
may be used to reduce interference. The bandpass filters 13', 13" can 
operate on beamformed signals, but the arrangement of Figure 22 is 
preferred in practice. 

When the transducer 16 is swept by rotating it about the azimuthal axis 
A, the preferred format for the image data array 18 is the sector format. 
Acoustic line data acquired by in the sector format can be conveniently used 
in the correlation process without scan conversion, since, for example, a pure 
rotation in rectangular coordinates can be represented as a change in an 
angular coordinate in a suitably chosen cylindrical coordinate system, given 
knowledge of the line to line angular increment, the angles of the lines with 
respect to the normal line (see Figure 15), and the sample to sample range 
increment 

The Motion Estimator 38 

Motion detection may be performed manually, for example by placing a 
line on the display data at a particular recognizable feature in the image 
planes 60, 62 and then repeating this activity on subsequent frames. The 
system can keep track of the line position for successive frames to generate a 
vector indicative of frame-to-frame motion. 
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A better method is to use computer analysis of frame-to-frame motion 
using a cross correlation or similar method on the image data acquired with 
the tracking arrays 20, 22. Such techniques (which will be referred to herein 
generally as correlation techniques) have been used in the past for tracking 
blood flow. These methods do not require that a recognizable feature be 
present in the display area, and they can function adequately using only 
ultrasound speckle data. Speckle is a naturally occurring phenomenon in 
ultrasound images and is a result of the coherent nature of the reflected - 
waves from small scattering objects in the tissue. 

Any suitable correlation technique can be used, including cross 
correlation and the sum of absolute differences method as discussed in Bohs 
and Trahey "A Novel Method For Angle Independent Ultrasonic Imaging Of 
Blood Flow And Tissue Motion" (IEEE Trans, on Biomed. Eng., 38, 3, pp. 
280-286, March, 1991), Cross correlation is the well-known mathematical 
operation which uses sequentially obtained sums of multiplication operations 
for various translations of data in a search for the translation for which the 
two sets of data are best matched. The sum of absolute differences method 
is a computationally simpler correlation technique, but it achieves a similar 
net effect. The sets of data are translated by varying amounts. For each 
translation respective data values in each of the sets are subtracted and the 
sum of the absolute differences is calculated. If a particular translation gives 
a sum of absolute differences that is close to zero, then it is probable that the 
sets of data have been aligned by the associated translation. This translation 
required to achieve an alignment is an indication of the motion between the 
two respective frames at the sides of the image closest to the respective 
tracking array. As explained below, the motion at other parts of the image 
can be evaluated using the detected motion at both tracking arrays and linear 
interpolation techniques along the azimuth of the image data array 18. 

The size of the data block used in either type of correlation is a matter 
for optimization. Bigger blocks will have a reduced likelihood of a false match 
but will require longer calculation times. The maximum frame-to-frame 
displacement that can be detected is limited by the block size. Typically, 
searches are made to plus or minus one-half of a block size. By way of 
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example, a 16 x 16 pixel block may be used to detect a maximum translation 
of plus or minus 8 pixels. 

The motion estimator 38 can use any effective technique to determine 
motion based on the frames of data stored in the arrays 30, 32, 34, Motion 
estimation may be based on the entire frame or on portions of the frame. 
When portions are used, they may be selected to correspond to a well- 
defined feature in the image. Motion estimation may be used on a spaced 
subset of available data to save time if that is more efficient. For example, if 
samples are available on a 0.5 mm spacing, but optimized motion detection 
can be performed based on a 1 mm spacing, time can be saved by deleting 
alternate samples and performing motion detection based on only a subset of 
the available data. 

The tracking image data used for the motion estimation may take any 
one of a number of forms, including at least the following: 

1 . Adjacent pixels in the output display (which is interpolated from 
the actual acoustic line data); 

2. Selected pixels from a larger grid, such as every Nth pixel; 

3. Averages of groups of pixels, such as the average of a group of 
four adjacent pixels; 

4. Samples from pre-scan conversion beamformer acoustic line 

data. 

The beamformer outputs lines of acoustic data may be in polar or 
cartesian format. Since the relation between these lines of data and the 
physical lines of propagation are known, samples derived from these acoustic 
lines may be used in the motion detection. 

Figure 15 is a schematic view showing the position of a target at 
frames N and N+1 with respect to acoustic scan line data, In Figure 15 
re f erence symbol 70 is used for individual points at which the measurements 
were taken. These points are arranged at discrete intervals along the scan 
lines. Figure 16 shows the raw acoustic line data (prior to scan conversion), 
in which each row represents a respective scan line, and the points of 
measurement at respective ranges are as illustrated. In Figures 15 and 16 
the + symbol is used for the position of the target for both frames N and N+1 . 
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The motion estimator 38, when operating on frames N and N+1 , detects that 
the target has moved from scan line 1 to scan line 3 and the range has 
remained constant at four sample intervals from the origin. Since the scan 
lines are spaced at an angular separation of X degrees and the distance , 
between adjacent points 70 at the center of the motion block is equal to P 
millimeters, basic geometrical relationships can be used to prove that the 
lateral offset equals +8PsinXsin© and the depth offset equals -8PsinXcos0, 
where 0 is the angle in degrees between the center of the motion detection 
block and the normal line emanating from the scan line origin, and where the 
tracking array is operating in sector format. These calculations are 
approximate, but they demonstrate the manner in which raw acoustic line 
data can be used in the motion estimator 38. 

When acoustic line data is used in the motion estimator, it can 
correspond to digitized RF, digitized IF, digitized baseband, or rectified low- 
pass-filtered, envelope-detected signals. As an example of envelope- 
detected signals, B-mode data can be used. The acoustic line data signals 
may be real digital samples or complex (I, Q) data samples. 

In the presently preferred embodiment the approach used in the 
motion estimator 38 relies on the sum of absolute differences in a pixel block 
equal to 16 x 16 pixels. For reasons of efficiency it is convenient to use a 
specialized integrated circuit. The LSI Logic 64720 integrated circuit is 
designed to perform 16x16 motion detection at rates of up to 396 blocks in 
1/30th of a second. These circuits may be combined to yield higher 
throughput or larger block sizes. If the block size is reduced to 8 x 8 pixels, 
still higher rates are possible (4500 blocks in 1/30th of a second). This 
integrated circuit has the cost benefits of volume manufacture. Similar 
alternative integrated circuits may also be used. Alternatively, the entire 
operation can be performed using a suitably programmed general purpose 
processor such as the Texas Instruments TMS 32QC8Q. 

Preferably, the arrays 18, 20 are aligned with the array 16 such that 
the image plane 58 is aligned with the vertical axis of the image planes 60, 
62. For this reason, motion with respect to the centerline of the image planes 
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60, 62 can be used to determine the relative motion of the image plane 58. 
Data blocks are defined lying along the center line. 

Strictly only two motion detection operations per tracking array are 
required. However, by performing multiple tracking operations over various 
parts of the image (not necessarily on the center line), greater confidence in 
the accuracy of the method can be obtained. For example, as shown in 
Figure 13 a smooth, straight line fit can be used to obtain an average of 
multiple estimates of the component of motion being detected. In Figure 13 
the dashed arrows represent the fitted component of motion and the 
continuous arrows represent the actual measures of the component of 
motion. By taking an average of multiple measurements a more reliable 
estimate is obtained. This average can be used both with respect to the 
amplitude and to the angle of the motion component vectors. 

Also, motion estimates which are radically different from neighboring 
estimates may be discarded as inaccurate. As shown in Figure 14 an image 
of onaof the tracking arrays can include an organ 72 having a bulk motion 
indicated by the arrows 74 which is different from the motion indicated by the 
speckle of the larger part of the area of the image. In this case the bulk 
motion of the organ can be disregarded, and the average of the remaining 
estimates of motion indicated by the shorter arrows 76 can be used as an 
estimate of the motion of the frame. One suitable approach is to quantize the 
motion vectors (length and direction), and then to find the most commonly 
occurring quantized length and direction. Next the actual (unquantized) 
vectors within a tolerance band (e.g. ± 30%) of the most commonly occurring 
values are selected and averaged to generate the desired estimate. 

Additionally, in a sum of absolute differences calculation, the ratio of 
the minimum sum to the average sum (after removing the minimum sum 
value) can be used as an indicator of the quality of the image motion 
detection. If the minimum sum is close to the average, then the calculation is 
susceptible to error, i.e. falsely detected motion. When the LSI 64720 
integrated circuit is used, the sum of the error values output is an indicator of 



J 

19 

a low quality result (a high error value sum corresponds to a low quality 
result). 

Low quality tracking may also be detected by comparing estimates of 
motion. Adjacent or successive estimates of motion which are not similar to 
one another may be an indication of low quality motion estimation. Of 
course, two or more of the approaches described above may be used in 
combination. 

Speckle patterns change rapidly as motion occurs. In particular, a 
speckle pattern will change if the elevation slice position moves. This is 
because speckle scatterers move in and out of the image plane rather than 
remaining within the plane and moving parallel to it. For this reason it is 
preferable in many cases to make frequent motion estimates as the 
transducer 16 is moved. The exact frequency of the estimates will depend 
upon the scale of the motion detection problem, which is related to the speed 
of motion imposed by the operator, the operator's ability to maintain slice 
position, and the nature of the speckle target (which is a function of tissue 
type and ultrasound frequency). 

By way of example, it may be determined that thirty image data frames 
from the image data array 18 provide sufficient imaging data for a desired 3-D 
reconstruction. However, it may be preferable to perform five motion 
estimates between each selected image data frame and to sum these 
estimates to calculate the net motion between the image data frames. Since 
cumulative errors are to be minimized, one way to achieve this result is to 
over-sample the motion detection operation and to average the results to 
reduce quantitation effects due to pixel size. With this approach there might 
be for example five frames from each of the tracking arrays 20, 22 for each 
frame of the image data array 18. 

While motion detection often works best when performed from a sum 
of small motion detections, there are situations when it is of value to use 
motion detection between frame N and frame N-M, where M is a integer 
greater than 1, such as 10. In principle, this approach can be used to correct 
cumulative errors. However, the probability of such a large motion being 
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correctly estimated is less. Therefore, the value of M is a matter for 
optimization. 

Since elevation slice affects speckle quality and stability, it may be 
preferable to track motion at the elevation focus of the lens. Alternately, jf the 
speckle dependence is too sensitive at the elevation focus, it may be 
preferable to avoid that area. It may be preferable to apply varying 
weightings to the detected motions during the smoothing operation to 
maximize the net accuracy by taking more account of more accurate data. It 
may be preferable to use an elevation focused array (1 ,5D array) or perhaps 
an unfocused array if that appears during experimentation to provide the best 
results. 

The data used for motion detection can taken many forms. Envelope- 
detected, scan converted data is a simple design choice, and is presently 
preferred. Alternatives include envelope-detected data prior to scan 
conversion and RF or baseband beamformer output signals prior to envelope 
detection. 

It is also possible for the user to select regions of interest if for some 
reason the user has specific preferences about which regions in the tracking 
data image would provide the best motion detection. For example, a user 
may choose not to use volumes of moving blood as regions for motion 
detection. 

During the collection of image data the preferred display is as shown 
in Figure 20. In Figure 20 an image from the image data array 18 is shown 
centrally on the screen and tracking images from the tracking arrays 20, 22 
are shown on respective sides of the screen. Preferably, motion detection is 
performed in real time, and the detected motion is presented on the display 
by indicating the calculated motion as it occurs in real time. This display can 
take the form of motion vectors as shown in Figure 20. Alternatively numeric 
measures of detected motion can be displayed. These displays indicate the 
relative position of the transducer in the sweep, and therefore provide the 
operator with an indication as to when the desired angular motion has been 
completed and also provide an indication of whether the motion detection 
system is working properly. Alternately, the image data may be displayed 
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without the tracking images or without display of the detected motion. In the 
event that the system-calculated motion vectors indicate low-quality tracking 
(such as erratic changes in the calculated motion vector within a single frame 
or between successive frames) the system can prompt the operator to begin 
again, as for example with an audio prompt such as an alarm or a visual 
prompt such as a flashing, reverse video message. 

If desired, the system 1 0 can be programmed to assist the user in 
achieving an optimum sweep rate, In many cases, optimum use of the motion 
estimators calls for an optimized sweep rate, i.e., a sweep rate that is large 
enough to avoid unacceptable error accumulation and small enough to 
remain within the range of movement of the motion estimator. Either an audio 
or a video prompt may be used. 

For example, when the motion estimator is adapted to detect ± 8 pixel 
motions, the system may emit an intermittent tone when the sweep rate is 
approximately correct (e.g., 4 pixels of movement per estimate). If the 
estimated movements are too small (e.g., less than 2 pixels), the intermittent 
tone is replaced with a low continuous tone, which becomes even lower if the 
sweep rate slows further. Conversely, if the estimated movements are too 
large (e.g., greater than 6 pixels), the intermittent tone is replaced with a high 
continuous tone, which becomes even higher if the sweep rate speeds up. 

A suitable visual prompt includes a variable-length arrow, which can 
have a longer length to prompt a faster sweep rate and a shorter length to 
prompt a slower sweep rate, and which can flash to indicate an optimum 
sweep rate. 

Another approach is to program the motion estimator to select the 
spacing in time of the frames that are correlated to estimate the component of 
motion. By properly selecting this spacing in an adaptive manner, the 
measured component of motion can be kept within the optimum range for a 
wide range of sweep velocities. For example, if there are many non-used 
tracking frames between each pair of correlated tracking frames, and if 8 
pixels is the maximum detectable motion, the number of non-used tracking 
fram.es between each pair of correlated tracking frames can be increased or 
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decreased as necessary in real time to maintain the detected motion in the 
range of 4 to 6 pixels. 

Low quality motion estimates can be weighted at a low level or entirely 
removed. One approach for selecting low quality motion estimates is first to 
fit a curve to all of the motion estimates (both in length and angle). Then the 
individual motion estimates are compared to the fitted curve, and motion 
estimates that deviate from the curve by more than a threshold amount such 
as 30% are considered low quality motion estimates and are deleted from the 
collection of motion estimates. Then the curve fitting operation is repeated 
using only the remaining motion estimates. If more than a certain fraction 
such as 20% of the motion estimates are classified as low quality estimates, 
the operation can be abandoned and the user prompted to repeat the sweep. 

In general, it is often necessary only to determine the component of 
motion relating the relative positions of successive images. If required, it is 
also possible to determine the axis of rotation by drawing lines perpendicular 
to the determined motion vectors, as shown in Figure 12. When this is done 
the length of the motion vector is an indication of the distance of the motion 
vector from the axis of rotation. 

Strictly speaking, it is not necessary to have two tracking arrays 20, 
22. However, when two tracking arrays are used, the ability to deal with 
impure rotation (where one end of the image data array 18 is rotated more 
than the other) is substantially increased. Furthermore, when multiple 
tracking arrays are used and motions for various ranges on each tracking 
array have been determined, interpolation may be applied to find the center 
of rotation that applies for all intermediate points in the range direction on 
each tracking array. 

Since the tracking arrays are on either side of the image data plane, 
and the exact geometry of the image data plane with respect to the tracking 
arrays is known, it is possible to interpolate linearly along the image data 
array azimuth axis to calculate the exact pixel translations for all points on the 
image data plane. 

Typically, motion estimates are collected along a straight line or across 
a rectangular grid. Due to the constraints of the array geometry and the 
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propagation of the straight acoustic lines from the array, the theoretical 
behavior of the motion vectors as a function of depth must satisfy certain 
constraints. In particular, the lengths of the motion vectors should vary 
linearly with depth, These constraints can be used to reduce the error in,the 
estimated motion. For example, a sequence of motion estimates can be 
acquired as a function of depth and then converted to motion estimate 
vectors (length and angle). A straight line is then fitted using well known 
methods to determine the best fitting line to the actual data for the length 
component. A second straight line is then fitted to the actual data for the 
angle or direction component. These fitted lines (comprising length and 
direction) can be linearly interpolated along the azimuthal direction during 
three-dimensional reconstruction at intermediate locations other than those 
used to derive the motion vectors. 

Note that if the patient and the transducer 16 move slowly together, 
loss of performance is not necessarily the result, as long as the relative 
position of the transducer 16 with respect to the patient is largely maintained. 

In order further to improve motion estimation it may be desirable to 
utilize only images corresponding to selected portions of the ECG cycle or 
the breathing cycle. Both ECG gating and breathing gating are well known in 
three-dimensional reconstruction of images. See, for example, McCann et al. 
"Multidimensional Ultrasonic Imaging for Cardiology" at p. 1065. With ECG 
gating a window is selected a fixed time duration after the ECG pulse 
maximum. With breathing gating it is often simplest to ask the patient to hold 
his or her breath for the short duration of the ultrasonic scan. Alternatively, 
chest motion can be recorded using a displacement sensor, and data can be 
selected for a portion of the breathing cycle. 

Various other techniques can be used to optimize motion estimation. 
For example, accuracy can be improved by interpolating to finer and finer 
pixels. Noise in the data can be removed using a low pass filter or a median 
filter, and the mapping of voltage level to brightness can be optimized for 
motion estimation purposes. Typically, logarithmic compression is used on 
the tracking arrays 20, 22, and this logarithmic compression can be optimized 
independently of the logarithmic compression used for the image data from 
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the- image data array 1 8. The particular mapping that is used can vary widely 
according to the operator's wishes. It is likely that in many cases motion 
detection will function most efficiently using a different mapping than that 
used by the operator for the image data. If desired, the system 10 can vary 
the mapping used internally for the data from the tracking arrays 20,22 until a 
mapping is found that provides high quality motion detection. 

Three-Dimensional Volume Filling Computer 36 

Many approaches can be taken in aligning the image data frames to 
provide the desired three-dimensional reconstruction. One example is shown 
schematically in Figures 17-19. In this example, the image data frames prior 
to reconstruction are shown schematically in Figure 17. The image data 
frame for the central plane is inserted at a plane aligned with the center of the 
volume, as shown in Figure 18. Working outwardly from this center plane, 
successive image data frames are inserted into their appropriate XYZ 
locations, as shown in Figure 19. Once all frames have been inserted, 
intermediate points are calculated using three-dimensional linear 
interpolation techniques relying on the eight closest known data points, 
arranged as a cuboid around the point to be interpolated. Such three- 
dimensional manipulation techniques are known, and are therefore not 
described in detail here. 

One approach is to use the scan conversion interpolation method ' 
described by Leavitt in Hewlett Packard Journal, October, 1983, pp. 30-34, 
adapted for use in three dimensions. The approach described by Leavitt 
operates with data in a two-dimensional plane. Data in three dimensions can 
be treated in two successive two-dimensional operations. Image plane data 
can be scan converted and interpolated as described by Leavitt, using pixel 
spacings that match the requirements of the three-dimension scan 
conversion. Then an orthogonal two-dimensional scan conversion can be 
performed at each azimuthal position to fill out the volume in the 
perpendicular direction. The Leavitt technique assumes that the axis of 
rotation for successive two-dimensional images is correctly aligned. If this is 
not the case, other volumetric reconstruction methods can be used. Suitable 
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reconstruction methods are well-known and are used with conventional 
magnetic sensor-based systems. 

if successive frames are detected to be too close together, some of the 
frame data may be discarded. If there are a large number of frames, it is 
5 possible to keep only those which happen to be spaced close to some 

desired uniform spacing. For example, if the desired spacing for 
reconstruction is 2° and data is acquired at 0, 1.2, 2.1, 2.8, 3.9 degrees, then 
frames 1 , 3 and 5 can be approximately assumed to be the correct frames 
lying at approximately 0, 2, and 4 degrees. The error from the approximation 
10 is insignificant and may result in simplicity in the reconstruction. 

Translation Detection Techniques 

It should be noted that a component of motion within the image data 
frame can also be detected using the techniques discussed above. This 
component of motion will be parallel to the azimuthal axis, and can be added 

15 to the motion detected with the tracking arrays, which is perpendicular to the 

azimuthal axis. Since the image data from the image data array 18 will move 
significantly due to motion of the elevation plane, it is preferred that motion 
detection be over-sampled in this plane. Preferably, only a measured net 
motion is applied during the reconstruction, as discussed above in 

20 conjunction with Figure 14. 

Also, motion can be detected in the plane of the image data frame 
when the transducer 18 is moved in translation along the azimuthal axis, as 
opposed to the rotational sweeps discussed above. With this approach, an 
extended field of view can be provided by axially shifting the transducer 16 

25 along the azimuthal axis, without rotating the transducer 16. If the only 

interest is in tracking such linear translation, the tracking arrays 20, 22 are 
not required. 

As used herein, extended field of view denotes a system which stores 
image data from a transducer array as the transducer array is shifted axially 
30 along its azimuthal axis. Data from the array at various positions along the 

azimuthal axis are then registered for reconstruction to form an extended field 
of view image. 
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The extended field of view discussed above can be reconstructed with 
data from either one of the tracking arrays 20, 22 or the image data array 1 8. 
More logically, the image data array 18 is used, because the image data 
array 18 is optimized for image quality. The image data array is then 
translated with respect to the target tissue, with its azimuthal axis oriented 
parallel to the line of motion. Image motion detection using the techniques 
described above is performed on image data from the image data array 18. 
Successive frames of image data from the array 18 are stored, along with 
displacement information defining the motion between frames of image data. 

Once the sweep of image frames has been completed, the 
displacement information is used, starting with the most recently acquired 
image data frame, to register successive ones of the image data frames with 
respect to one another in proper alignment, in the tissue sense. The older 
image data is then superimposed on the newer image data. Typically, most 
of the older data will almost exactly match the newer data, but a small non- 
overlapping region will be present which represents data acquired at the 
older image position which could not be acquired at the newer image 
position. Preferably, during the writing of the older data over the newer data, 
only the non-overlapping region is written. This approach eliminates 
redundant image writing operations. This procedure is then continued for 
progressively earlier frames of image data until all of the frames in the sweep 
have been reassembled for display. 

There is a potential that attempts may be made to write beyond the 
limits of memory. If this situation is detected the image data can be scaled to 
make it smaller to fit into the available screen memory. Scaling may be 
achieved by remapping the pixels to a new memory using geometric 
transformation and interpolation, as is well known in the computer graphics 
field. 

The following methods can be used either alone or in various 
subcombinations to enhance motion detection. 

1 . Frequency selection. In one example, every Nth frame is used 
for motion detection. On every Nth frame a different frequency is used to 
excite the transducer elements of the image data array 18 in order to modify 
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the speckle pattern in such a way as to enhance the capability to detect 
motion. Since only relative motion is required, it may be preferable to use a 
higher frequency to obtain higher resolution speckle data at every Nth frame. 
Higher frequencies are associated with reduced penetration depths, but as 
5 discussed above this may not be a drawback since only shallow target data 

may be required for motion detection. Alternately, higher frequencies may 
make speckle highly position sensitive. This may be undesirable if it causes 
the motion detection operation to fail due to an inability to track features that 
move in and out of the elevation plane of the image. In this case, it may be 
1 0 preferable to use a lower frequency for the motion detection frames. 

2, Bandwidth adjustment. As above, selected ones of the image 
data frames may be optimized for motion detection, in this case by optimizing 
the bandwidth as well as or instead of the center frequency for motion 
detection. 

15 3. Elevation focusing. When a 1.5 dimension array is used, 

elevation focusing can be adjusted during the sweep to optimize some frames 
for image data collection and other frames for motion detection. For example, 
to reduce the impact of elevational motion, it may be preferable to defocus 
the beam slightly in those image data frames used for motion detection. 

20 4. Azimuthal focusing. Similarly, it may be preferable to defocus 

the acoustic beam slightly in azimuth for selected frames to stabilize motion 
detection without degrading motion detection excessively. 

When any of the four approaches discussed above are used, the 
image data frames that are optimized for motion detection need not be 

25 displayed on the screen. Instead, only the image data frames that are 

optimized for imaging can be used. 

Since during a slow sweep there is redundant data (multiple data 
points for individual positions within the tissue), it may be preferable to mix 
the use of different frequencies, bandwidths and focusing methods to collect 

30 redundant motion detection data. After multiple redundant data is collected, it 

can be averaged to arrive at a motion estimate which is more reliable and 
less vulnerable to error. 
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By way of example, if the array is moved at two millimeters per second, 
the required minimum motion which can be usefully resolved is 0.5 
millimeters, and the frame rate is forty frames per second, there will be ten 
frames between times when useful motion detection can be obtained. Also, 
we need only one image data frame for each of these ten motion detection 
frames. If we consider the first twenty frames, frames 1 and 1 1 can be image 
data collected using user- determined center frequency and bandwidths. 
Frames 3 and 13 can be motion detection frames with first alternative center 
frequency and bandwidth. Frames 5 and 15 can be motion detection frames 
with second alternative center frequency and bandwidth, and frames 7 and 17 
can be motion detection frames with the first alternative center frequency and 
the second alternative bandwidth. Frames 9 and 19 can be motion detection 
frames using a changed focusing scheme. Frames 2, 4, 6, 8, 10, 12, 14, 16, 
1 8 and 20 are captured as if they were image frames and are displayed, but 
are not stored or used for tracking. The detected motion from frames 1, 3, 5, 
7 and 9 with respect to frames 11, 13, 15, 17 and 19, respectively, may then 
be averaged or sorted so as to eliminate motion estimates which are 
significantly different from other estimates. 

All of the techniques described above in connection with extended 
fields of view can be adapted for use with motion detection in angular sweeps 
as described above. 

In the case of a complex motion involving motion in both the planes of 
the tracking arrays and motion in the plane of the image data array, the actual 
motion may be calculated approximately from the sum of the tracking array 
motions and the image data array motions, separately measured. If after the 
sum of such motions is obtained it is found that the second motion to be 
applied has caused the first motion to have been modified, a recursive 
operation can be employed until a three-dimensional motion is found which 
correctly satisfies the detected motions in all arrays. A Monte-Carlo method 
for finding the components satisfying a complex motion may be used. 
Additionally, new motions may be estimated from the last frame-to-frame 
motion which was calculated. As a last resort, the system can find that it is 
unable to determine a set of motion component vectors which satisfy the 
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detected motions and can signal the operator to repeat the last sweep. The 
simpler, smoother, and purer that image movement is in any given image 
plane, the easier it is to implement motion detection. 

Alternative Embodiments 

5 A simpler device for implementing the bi-plane imaging techniques 

discussed above can be constructed as follows. This device also uses a 
linear array for the image data acquisition and two small linear arrays of 
equal pitch that are mounted to move with the larger linear array. The two 
small linear tracking arrays are coupled to a connector similar to that used by 

10 the image data array, but the transducer elements are divided so that the 

transducer elements for each tracking array are coupled to the transducer 
connector near the opposite ends of the connector. For example, for a 1 28 
conductor connector and a 10 element tracking array, the conductors 10-19 
and 100-109 can be used for the two tracking arrays. Both the image data 

1 5 array and the combined tracking array are provided with a connector of the 

same type and are designed to operate with the same beamformer. The two 
connectors are inserted into the left and right ports of a suitable ultrasonic 
imaging machine, such as the Acuson Model XP, and an image storage 
device such as a VCR is provided. As the array is rotated slowly the operator 

20 presses the array select switch (left versus right) repeatedly at a high rate 

and the resulting images are stored for off-line analysis. At the end of the 
sweep, the VCR tape is played back on a frame-by-frame basis. Successive 
sets of frames, each set consisting of a frame from the image data plane and 
each tracking image plane, are transferred via standard video transfer 

25 techniques to a computer memory. The computer is programmed to analyze 

the tracking image plane data for motion detection using the methods 
discussed above. The tracking image will in fact appear as two images, one 
on each side corresponding to the two spatially separated tracking arrays. 
The two images are analyzed separately. 

30 As a preferred modification to the simplified system described 

immediately above, the ultrasonic imaging machine is preferably programmed 
to perform the array switching operation and to transfer one set of frames 
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from each sequential sweep to computer memory or to a suitable storage 
device. 

Alternative Transducers 

Many variations are possible on the preferred transducers described 
above. For example, crossed arrays of the type described in Hashimoto U.S. 
Patent 5,327,895 and Schaulov, et al., Ultrasonics Symposium, pp. 635-638 
(IEEE, 1988) can be adapted for use with this invention. Such crossed arrays 
typically include a PZT plate which is diced in perpendicular directions. The 
kerfs are filled with a low-durometer polymer such as a low-durometer epoxy. 
Linear electrodes (defining the array elements) are applied to the top and 
bottom surfaces, and the electrodes on the top surface are oriented 
perpendicularly to the electrodes on the bottom surface. When using the 
array in one direction, all electrodes on the top surface are grounded and the 
electrodes on the bottom surface are excited with the phased excitation 
pulses. The electrodes on the bottom surface are then monitored for 
detected echoes. When using the array for the other direction, the bottom 
surface electrodes are grounded and the top surface electrodes are operated 
in a phased manner. 

Both arrays in a crossed array configuration may be used 
simultaneously. For example, one array may be operated using a different 
center ultrasonic frequency than the other. Also, both arrays may be used 
independently of one another, as indicated by the principle of voltage 
superposition, thereby accommodating simultaneous operation of both 
arrays. 

Figures 23-26 show schematic views of four crossed arrays that can 
be used to collect both image data and tracking information. In the 
transducer 100 of Figure 23 the elements 102 form a conventional one- 
dimensional array that can be used to collect image data. Crossed elements 
104 at both ends of the transducer 100 can be operated as tracking arrays as 
described above. The transducer 100' is similar to the transducer 100 except 
that the crossed elements 104' are provided only at one end. 
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The crossed array 100" of Figure 25 is also similar to the array 100 of 
Figure 23, except that the crossed elements 104" are provided only at the 
center of the transducer. Figure 26 shows a transducer 100'" which is similar 
to the transducer 100" of Figure 25, except that the crossed elements 104'" 
5 extend over the entire length of the array. 

As shown in Figures 23-26, one or more tracking arrays can be 
integrated with an image data array using the crossed array technique. The 
crossed array is operated in the normal manner along the long, azimuthal 
axis to obtain 2-D image data. The crossed arrays are operated to obtain 

10 data along the elevation direction to obtain the perpendicular tracking data. 

In this way the footprint of the transducer is minimized. If desired, the 
tracking data may be acquired from the same volume of tissue as that being 
interrogated to obtain the image data. 

Figure 27 provides a schematic view of another transducer 1 10 which 

15 includes an image data array 112 and a single tracking array 114, In this 

case the tracking array 1 14 is oriented perpendicularly to the image data 
array 112, As shown in Figure 27 the tracking array 1 14 is laterally offset 
from and centered with respect to the image data array 112, 

Figures 27a through 27e show five alternative transducers, each 

20 including a single image data array 112 and at least one tracking array 1 14. 

In the transducer of Figure 27a there are two tracking arrays 114, both 
laterally offset from and centered with respect to the image data array 112, In 
the transducer of Figure 27b there is a single tracking array 1 14 that is co- 
linear with and axially spaced from the image data array 1 12, 

25 The transducer of Figure 27c includes two tracking arrays 114, both 

positioned to the same side of the image data array 112 near opposite ends 
of the image data array 112. The transducer of Figure 27d is similar to that of 
Figure 27c, except that the two tracking arrays 114 are positioned on 
opposite sides of the image data array 112. The transducer of Figure 27e 

30 includes four tracking arrays 114, two on each side of the image data array 

1 1 2, near respective ends of the image data array 1 1 2. 

Figures 27f through 27j show additional transducers that can be used 
with this invention, each including a single image data array 112 and at least 
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one tracking array. In the transducer of Figure 27f, each tracking array 
includes two single-element transducers 114'. Each of the tracking arrays is 
situated near a respective end of the image data array 112, and the individual 
single-element transducers 114' are elongated elements oriented generally 
5 parallel to the azimuthal axis of the image data array 112, The two single- 

element transducers 114' in each tracking array can be operated as an 
interferometric, two-element transducer array. The single-element 
transducers 1 14' can be fired using a narrow-band transmit signal, for 
example either in phase or 180° out of phase. Receive signals generated by 

1 0 the two single-element transducer elements 1 1 4' can then be added together 

to create a summation signal. Consecutive summation signals can then be 
compared to one another with various offset delays. The offset delay which 
gives the best correlation (in a least squares sense for example) is a function 
of the motion of the transducer between the respective firings of the 

15 transducers 114'. Using this best correlation time delay, and taking into 

account the sound propagation velocity through the two way path, one can 
then determine the associated physical displacement of the transducer 
between the associated firings, as described in detail above. 

The comparison operation may be performed in either the time or the 

20 frequency domain. If the frequency domain is used, complex values or phase 

values are preferably compared. For many applications a time domain 
comparison will be simpler. Because the two single-element transducer 
elements 1 14 1 within a single tracking array are relatively widely spaced, they 
provide the benefit of relatively good lateral resolution. High grating lobes 

25 will typically be associated with this configuration, but it is envigaged that 

high side lobe levels will be less objectionable for use in an automated 
tracking algorithm than for use in a gray scale display intended for human 
interpretation. 

In some applications the method described above would principally 
30 detect motion parallel to the beam axis. In these cases it may be preferable 

to form the beams with a substantial component in the direction of the 
expected motion. Since motion is principally in the lateral direction 
(transverse to the azimuthal axis of the image data array 112), one option is 
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to form the beams at +/- 45° or +/- 60° from the central image plane of the 
image data array 1 1 2. 

As shown in Figure 27g, the single-element transducer elements 114' 
may be superimposed on the image data array 112. This can be done using 
crossed arrays as described above, or by placing one of the arrays physically 
over the other. In this case the upper array should be as nearly transparent 
as possible with respect to ultrasonic radiation emitted by the lower array. In 
the example of Figure 27g the image data array 1 12 may be an elongated, 
one-dimensional, ceramic-based array, and the single-element transducer 
elements 114' may comprise PVDF arrays mounted with perpendicularly- 
oriented elements on top of the image data array. In fact, the PVDF tracking 
array may perform the function of a matching layer for the image data array. 
A non-conducting plastic film may be placed between the superimposed 
arrays to prevent cross talk or shorting. 

As shown in Figures 27h and 27i, the single-element transducer 
elements 1 14" may take the form of circular elements which may be 
preferably focused at some range, as for example 40 millimeters. In this 
case, the receive signal generated by a single one of the single-element 
transducer elements 114" is compared with subsequent firings of the same 
single-element transducer element, and beamforming operations are 
eliminated. In this case, each individual one of the single-element transducer 
elements 114" acts as a respective tracking array, and the term "tracking 
array" is intended broadly to encompass such single-element arrays. 

As shown in Figure 27j, each individual tracking array 1 14"' may take 
the form of an annular array. Annular arrays are well known for use in 
mechanically scanned transducers, and they provide the advantage that they 
can be focused in transmit and dynamically focused in receive to produce a 
high quality beam profile. Each annular array 114'" is typically composed of 
cross-diced PZT ceramic with an epoxy filler. Chromium/gold spatter 
electrodes are applied to the PZT ceramic, and these electrodes are etched 
selectively (or mechanically scribed) to isolate approximately 8 discrete 
electrodes on one side. The reverse side has a continuous metalized layer 
and is grounded. As described above, the tracking arrays 114"' may be 
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oriented at ± 45° or ± 60° for example with respect to the central plane of the 
image data array 112. A low loss, non-refractive filler polyurethane such as 
the resin distributed by Ciba-Geigy as resin no. RP6400 or other suitable 
diphenylmethane diisocyanate polyurethane can be used to fill the spacQ 
5 between the transducer elements 1 14 ,n and patient tissue. 

Transducer geometries that place the tracking arrays alongside the 
image data array may reduce the overall length of the transducer, which may 
provide advantages in some applications. 

As shown in Figures 28 and 29, a transducer 120, 120' suitable for use 

1 0 in forming an extended field of view as described above can utilize an image 

data array 122 and a tracking array 124, wherein the transducer elements of 
the two arrays 122, 124 are parallel to one another. In the transducer 120 
the tracking array 124 is laterally offset from and centered with respect to the 
image data array 122. As shown in Figure 29, in the transducer 120' the 

15 image data array 122' and the tracking array 124' are collinear and separated 

from one another. With either of the transducers 120, 120' frame-to-frame 
motion can be determined using the tracking arrays 124, 124' and the 
compound image can be assembled from image data from the image data 
array 122, 122'. 

20 In any of the foregoing embodiments, some or all of the tracking arrays 

and the image data arrays may be formed as non-planar linear arrays such 
as curved linear arrays for example. Separate, oriented linear arrays may be 
used for each acoustic line if desired. 

Alternative Optimization Techniques For Tracking Data 

25 -Figure 30 is a block diagram of an alternative ultrasonic imaging 

system 10' that is in many ways similar to the system 10 of Figure 1. The 
same reference numerals have been used for comparable elements in the 
two drawings, and the following discussion will focus on the differences. The 
system 10' stores image data from the image data array 18 or one of the 

30 tracking arrays 20, 22 in a raw image data buffer 15. The data stored in the 

buffer 15 can be I, Q data or IF data, for example. Of course, the term "image 
information" is intended to refer broadly to information that varies with spatial 
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variations in the target, and in many cases image information is never 
displayed as an image. Preferably, the raw image data stored in the buffer 
15 includes tracking data stored with wide band ultrasound pulse operation. 
Image data from the buffer 15 is passed to a detector 21 through one of four 
alternative blocks. Block 17 is an all-pass block which performs no filtering, 
and which is typically used for image data from the image data array 18. 
Tracking data from one of the tracking arrays 20, 22 can be passed through 
one of three filters 19, 19', 19", which can have varying filter characteristics. 
For example, filter 19 may be a low-pass filter and filter 19' may be a high- 
pass filter. Filter 19" may be a band-pass filter centered in any desired 
portion of the frequency spectrum. 

The detector 21 can be any conventional detector, and it supplies a 
detected output signal to the scan converter 24. If desired, tracking data from 
the tracking arrays 20, 22 can be processed multiple times, using different 
ones of the filters 1 9, 1 9', 1 9". Of course, more or fewer filters can be used in 
alternative embodiments. 

The scan converter 24 preferably uses the well-known histogram 
equalization method to maximize contrast in the tracking image data. 
Histogram equalization is discussed for example in Gonzales and Woods, 
Digital Image Processing , Addison-Wesley, 1993, pp. 173-178, as well as in 
Kim U.S. Patent 5,492,125, The scan converter 24 may use a 2D low-pass 
filter and/or a 2D high-pass filter to smooth or otherwise process the tracking 
image data. 

Image frames from the scan converter 24 are stored in the frame 
buffers 30, 32, 34, and tracking sets of image data from the buffers 32, 34 are 
selectively applied to the motion estimator 38, The motion estimator 38 
estimates the relative motion between selected tracking image sets and 
applies these estimates of motion to a motion smoothing/summing block 40'. 

The motion smoothing/summing block 40' processes motion estimates 
from multiple motion detection operations. Preferably, each motion detection 
estimate is associated with a quality factor indicative of the confidence level 
associated with the motion estimate, For example, a suitable quality factor 
may be value of the minimum sum of absolute differences associated with a 
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particular motion estimate. The block 40' compounds multiple motion 
estimates using a weighted sum. For example, consider the situation where 
three motion estimates are available with the following values and associated 
quality factors Q: 

Estimate 1 - 5 Pixels to the right Q=0.9 
Estimate 2 - 3 Pixels to the right Q=0.8 
Estimate 3 - 2 Pixels to the left Q=0,2 

5 In this example, a high value of Q is associated with a high confidence 

level. The block 40' can form a weighted sum of these three motion 
estimates as follows: 

m r c r f (5x0.9) + (3x0.8) + (-2x2.0) 

Motion Estimate = — - — — — —~ 

(0.9 + 0.8 4-2.0) 

= 3,4 Pixels to the right 

The previous motion store 41 Figure 3 is used to store previous motion 
10 estimates until they are needed in forming the weighted sum described 

above. Other methods for using multiple motion estimates are described 
below. 

Other techniques that can be used to improve the quality of the motion 
estimate include the use of multiple transmit zones to acquire the best quality 

15 tracking image data and the use of a frequency-dependent focus as 

described in Hossack U.S. Patent 5,608,690, assigned to the assignee of the 
present invention, to acquire the best quality tracking image data. 

As pointed out above, the acquisition of image data via the array 18 
can be time multiplexed with the acquisition of tracking data via the tracking 

20 arrays 20, 22. In one alternative embodiment the time separation between 

consecutive tracking data frames is controlled adaptively to provide motion 
estimates that fall within a desired range. As explained above, if the motion 
estimate (i.e. displacement) between consecutive tracking frames is 
excessive, there is a danger that the displacement may exceed the 

25 measuring capabilities of the motion estimator 38. Conversely, if the motion 

estimate between consecutive tracking frames is too low, excessive 
computational time may be used in creating motion estimates. Additionally, if 
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the motion estimates are small, the relative errors will be large, and 
compound errors may reach undesirable proportions. In order the avoid 
these problems, a controller can be provided as described above to 
determine the number of image data frames that are collected between 
5 consecutive tracking frames, and this can be accomplished in an adaptive 

manner as shown in Figure 31. 

In Figure 31 the variable N is used to specify the number of image 
data frames that are collected between consecutive tracking frames. As 
shown Figure 31, N is initially set to a constant K1, and the controller then 

1 0 waits for a new motion estimate from the motion estimator 38 of Figure 3. If 

this motion estimate is above a desired range, than N is reduced by the 
amount A, Conversely, if the motion estimate is below the desired range than 
N is increased by A. Once N has been revised if necessary, the controller 
then waits for a new motion estimate from the motion estimator 38. In this 

15 way the motion estimate is maintained within a desired range automatically, 

and problems associated with excessively large motion estimates or 
excessively small motion estimates are avoided. 

Image Transfer Optimization Techniques 

The system 10' of Figure 30 is well-suited for use in situations where a 
20 remote computer is used to perform motion estimation, either in real time or 

after a delay, In this context remote may mean that the motion estimating 
computer is connected via a cable or other data link. As shown in Figure 30 
image data frames from the buffer 30 can be compressed using any suitable 
compression technique such as JPEG prior to transfer to the potentially 
25 remote site. After the image data has been received at the potentially remote 

site, it is decompressed as shown in block 35. Similar compression and 
decompression blocks can be interposed between the buffers 32, 34 and the 
motion estimator 38. For example, remote motion estimation and 3D volume 
reconstruction can be performed on a remote workstation such as the AEGIS 
30 workstation of Acuson Corporation, the assignee of the present invention. 
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Alternative Motion Estimation Techniques 

In the event that motion between consecutive tracking frames is small 
(less than one pixel) there is a danger that motion may be mis-estimated if 
each tracking frame is compared with the immediately preceding tracking 
frame. For example, if the separation between adjacent tracking frames were 
1/3 of a pixel, the comparison of each tracking frame with the immediately 
preceding tracking frame would detect no motion, in order to overcome this 
problem, the motion estimator 32 of Figure 30 preferably is controlled using 
the algorithm of Figure 32. In this algorithm, N defines the frame number of 
the image region used as a reference in estimating motion, and the symbol 
N+i is used to designate the frame number of the image region that is to be 
compared with the reference image region. As shown in Figure 32 the first 
step is to set i=1 and then to determine whether motion was detected 
between image region N and image region N+i. If not, i is incremented and 
control is returned to block 130. Once motion is detected in block 130, the 
reference image frame is updated to equal N+i, i is reset to 1 , and control is 
returned to block 130. 

For example, consider a sequence of tracking frames 1, 2, 3 and 4. 
Assuming no motion is detected between frames 1 and 2, then frame 3 will be 
compared with frame 1 . Assuming no motion is detected between frame 3 
and frame 1 , then frame 4 will also be compared with frame 1 . This process 
is repeated until motion is detected, and it is only then that the reference 
frame is updated to the new frame at which motion was detected. In this way, 
multiple subpixei motions do not go undetected, because subpixel motions 
eventually sum to the point where they become detectable. 

The selection of the reference image region does not necessarily 
correspond to an entire frame. If frame motion is zero at the top and non- 
zero at the bottom of the frame (as might be the case with a fan-like sweep), 
then the older frame portion is preferably kept as the reference for motion 
detection at the top of the frame, while the bottom of the frame is updated 
once motion is detected in that region. 
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Since the tracking arrays 20, 22 are principally swept along the 
surface, the majority of motion will be in the elevation direction rather than the 
depth direction. During the search for the minimum sum of absolute 
differences (MSAD), it is preferable to make the search region rectangular 
rather, than square. For example, instead of searching an area 64 x 64 
pixels, a 128 x 32 pixel area can be searched in the same time (128 lateral 
search, pixels and 32 depth search pixels). Similarly, if the maximum motion 
is 64 pixels, then by limiting the area of the search to 32 x 64 pixels, the 
search time is greatly reduced. 

Additionally, frame motion can be interpolated to further reduce 
processing time. For example, if tracking frames 1 , 3 and 5 are used for 
motion detection (rather than 1 , 2, 3, 4 and 5), then detected motion between 
frames 1 and 3 can be interpolated to determine the motion for frame 2. In 
this case the interpolated motion for frame 2 would be one-half of the 
detected motion between frames 1 and 3. This method allows reduced 
processing time to be spent for motion detection, but allows all acquired 
image data to be employed in the highest quality 3D image. Interpolation of 
this type may be performed in the 3D volume translation/interpolation block 
36 of Figure 30. 

Various alternative approaches can be used in the motion estimator 38 
to further reduce processing time. For example, if a small set of acoustic 
lines are transmitted, received and stored as one-dimensional RF or 
baseband signals, then vector components of motion along each of these 
lines can be estimated by correlating successive sample sequences along 
the lines. In this way the vector component of motion in each of the line 
directions can be determined, and these vector components of motion can be 
summed to create the final two-dimensional motion estimate. If desired more 
than two acoustic lines may be used in the set, but the following example 
uses two perpendicular acoustic lines. 

For example, as shown in Figure 33, the tracking array 20 can be used 
to store two acoustic receive lines 140, 142 which are perpendicular to each 
other. These lines can be considered to make up a single frame of tracking 
data. The line 140 can be cross-correlated between two separate frames of 
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tracking data to find the vector component of motion along the direction of the 
arrow 144, and similarly the lines 142 in these two frames of tracking data 
can be used to determine the vector component of motion in the direction of 
the arrow 146. These two components of motion can then be summed as 
vectors to estimate the two dimensional motion between the two frames of 
tracking data. Cross-correlation techniques suitable for adaptation to the 
current task are described in Engeler U.S. Patent 4,937,775, O'Ponnell U.S. 
Patent 4,989,143 and Wright, et al . U.S. Patent 5,570,691. The Wright, et al , 
patent is assigned to the assignee of the present invention. 

Preferably, a register is used to store the complex sampled beam data 
from one firing in one of the two directions. When, an instant of time later, 
the same beam is formed again, the resulting sampled beam data is cross- 
correlated with the data in the register. From the position of the cross- 
correlation peak, the relative time delay between the two signals is 
determined. The cross-correlation process may operate on one or more 
portions of the available line data. By detecting motion via cross-correlation 
at a number of points along each line, separate motions can be determined at 
the top and bottom of the image, and hence rotations as well as translations 
can be estimated. From the time delay determined by the cross-correlation 
peak, the component of transducer motion (parallel to the beam axis) 
required to cause the measured time delay is inferred from the known speed 
of sound in tissue and taking account of the fact that the delay is related to 
two-way path length. This process is repeated for the other line (preferably 
oriented perpendicularly to the first line) to find the other vector component of 
motion. These two vector components are then summed to find the estimated 
actual transducer motion at that point along the array. Similarly, the process 
is typically repeated at the second side of the array for the second tracking 
array. 

In one embodiment, the two lines (and therefore the two beams) are 
oriented at ±45 degrees, and there is therefore a strict requirement on 
element spacing if grating lobes are to be avoided. In another embodiment, 
the two lines are oriented at ±60 degrees to enhance the accuracy of motion 
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detection along the skin of a patient. Preferably, the transducer elements 
should be spaced at one-half wavelength or less. This requirement may 
encourage the use of a lower frequency for the tracking arrays than for the 
image data array. However, it is possible that the cross-correlation technique 
5 will be able to track delay to a small fraction of a wavelength. As before, the 

comparison between one set of tracking data and the next may not be made 
on every acquired set of tracking data, but rather on a time-spaced subset. 
For example, if motion is fast, motion estimates can be made between every 
consecutive pair of sets of tracking data, but if motion is slow a longer time 
10 between motion estimates is allowed. 

Fast Motion Detection Search Techniques 

4" A variety of methods are available for speeding up the search for the 

T- estimated motions. These methods can be used with any of the 

~e : embodiments described above. 

^v1 5 1 . Either the system controller or a user input may vary the block 

W size to be searched. Large block sizes require more computation, but for 

Cs certain image types (e.g. noisy data) large blocks will give a higher quality 

^ result (i.e. lower minimum SAD versus mean SAD) 

2. The system adaptiveiy changes the search area based on the 
■:;:20 previous motion estimate. If the last motion was 10 pixels to the right then 

the search may be over an area from 0 pixels to the right to 20 pixels to the 
right, i.e. the search area is centered on the expected motion as indicated by 
the previous motion measurement). 

3. If the detected motions exhibit little variation (e.g. 7, 8, 10, 9 
25 pixels to the right in successive motion measurements, as opposed to 5, 15, 

8, 12 pixels) then the system may use a smaller search area since there is a 
relatively high degree of confidence that the motion will be between 7 and 10. 
Conversely, if successive motion estimates are widely varying, then the 
system preferably uses a larger search area in order to maximize assurance 
30 of a successful search (i.e. the motion is not beyond the limits of the search 

area). In the above example, if pixel motions are 7, 8, 10, 9 then we use a 15 
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x 15 search area but if pixel motions are 5, 15, 8, 12 then we use a 30 x 30 
search area. 

4. Since most motion is expected in the lateral direction rather 
than in the range direction (because the transducer is drawn across the skin 
surface) the search area may be asymmetric, e.g. +/- 5 pixels in range 
direction and +/- 20 pixels in the lateral direction. 

5. The search may be performed at multiple levels of spatial 
resolution. Initially, the search is made coarsely along the lateral direction 
only, e.g. test every second pixel location. Once the approximate lateral offset 
has been thus detected, a fine search (every pixel location) is made in both 
the lateral and range direction. 

6. Hierarchical motion detection can be used based on multiple 
levels of signal level resolution. Initially, only the most significant 2 or 4 bits 
associated with each pixel intensity level are used to find the position with the 
minimum SAD. Once the location has been approximately found, a second 
level of search is performed in that region using all the bits, typically 8. More 
than two levels of hierarchy can be used. 

Higher Resolution Tracking Techniques 

The finest level of motion detection may be enhanced by interpolating 
additional pixels between the available pixels. An alternative method 
described by Li and Gonzales, IEEE Trans on Circuits and Systems for 
Video Techn ., 6, 1, pg. 118 (Feb., 1996), calculates the motion estimate to 
sub-pixel resolution based on the values of the neighboring SAD values to 
the one with the minimum SAD. 

Techniques for Combining Motion Estimates 

The final estimate of transducer motion is preferably based on a 
composite of multiple inputs. Preferably these inputs are weighted so that 
those that appear to possess the greatest quality (or certainty) are given the 
most weight. Inputs which are contradictory with the majority of inputs are 
either eliminated from the composite calculation or are given very small 
weightings, 
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Firstly the ratio of minimum sum of absolute differences ("min_SAD") to 
mean sum of absolute differences ("meanJBAD") is used as a quality factor. 
A low ratio indicates a high quality result and a result close to 1.0 indicates 
an unreliable estimate. In practice a good ratio is rarely less than 0,3. 
Assuming that ratios lie in the range 0.3 to 1 .0, we can convert this into a 
weighting function in the range 0,0 to 1.0, where 1.0 means an ideal (high 
certainty) result and 0.0 means an unusable result: 

WeightingJWSAD = (1 - (min_SAD/mean_SAD)) / 0.7. 

If the minimum observable SAD is < 0.3, then this equation can be 
modified: 

Weighting_MSAD = (1 - (min_SAD/mean_SAD)) / (1- min_observab!e_SAD). 

A second quality factor is based on the similarity of the present motion 
estimate to the previous estimate, This approach is based on the observation 
that during a smooth scan typical of that which would be used in practice, the 
actual relative motion between one set of tracking data and a subsequent set 
of tracking data is similar. If a motion estimate predicts a reversal in motion, 
then it is probable that it is a bad estimate. Causes for bad estimates may 
include a noisy image, poor pixel contrast, or the presence of large amounts 
of flowing blood. Notice that the previous motion estimate that is used as a 
reference may be either the raw estimate of motion from the MSAD operation 
or the previous smoothed and weighted estimate. Preferably, the smoothed 
previous motion estimate is used as the reference to which the most recent 
raw motion estimate is compared. 

in the current example the degree of similarity between two estimates 
of motion is calculated as follows. This example is for Y (elevation) direction 
motion, but it can be applied to Z (depth) direction motion. Weighting_seq is 
the weighting factor that is generated based on a comparison of sequential 
estimates. 

Weighting_seq=1 - [abs (Ycurr-Ylast)/(abs (Ycur) + abs (Ylast))], 
where Ycurr = the current estimate of Y motion, and 

Ylast = the last estimate of Y motion, smoothed. 
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For the initial motion calculation, no measure of similarity to a previous 
estimate is possible, so the initial motion-related weighting must be given an 
arbitrary value such as 0.5, 

A composite weighting factor ("Weighting^comp") is then formed. 
Depending on experience with real tissue scanning, one may select to bias 
the weighting more to either the MSAD quality or to the sequential quality. 
Currently 0.75 of the total weighting is related to the MSAD quality and 0.25 
to the sequential quality, 

Weighting_comp = 0.75 x Weighing_MSAD + 0.25 x Weighting_seq. 

These weightings are calculated for all the points for which motion 
estimates were made. In an example 6 motion estimates were made in the 
range direction. Each used a 48 x 48 pixel block. 

Since for a real motion the equation describing the motion as a 
function of depth must follow a straight line, we can fit the obtained motion 
estimates to a straight line. Preferably, the motions are fitted using a 
weighted least squares method wherein the weightings are those described 
above for each of the range points for which a motion estimate is available. 
This process is repeated for both Y direction motion and Z direction motion. 

Finally, having determined the fitted motions, we have the line defined 
in terms of an intercept (c) and slope (m): Y_motion = mZ + c. 

Similarly, the Z motions as a function of the Z observation points are 
calculated: 

Zjmotion = mZ + c (different m and c). 
Although one would typically expect Zjnotion to be a constant as a 
function of Z, it is not in the case of transducer rotation about the azimuthal 
axis. 

This fitted value may be further smoothed based on the average of the 
parameter Weighting_comp. Hence, in the presence of a very poor quality 
estimate, the current estimate is based principally on the previous (rather 
than the current) estimate: 

mjnod = fact * (mean (Weighting_comp)) * m + (1-fact * (mean (Weighting_comp)) * mjast 
cjmod = fact * (mean (Weighting_comp)) * c + (1-fact * (mean (Weightmg_comp)) * cjast 

c the current estimate of intercept 
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cjast the intercept from the previous pair-of-frames motion estimate 

c_mod the modified intercept 

m the current estimate of slope 

mjast the slope from the previous pair-of-frames motion estimate 

m_mod the modified slope 

fact a factor to determine how much significance to attach to the 



weighting (fact =1.0 presently) 

Alternatively, the final Weighting_comp may be determined using fuzzy 
logic. A fuzzy logic control block takes as inputs WeightingJVISAD and 
Weighting_seq and combines them to form an output which is 
Weighting^comp. Inputs WeightingJVISAD and Weighting_seq are first 
assigned to classes (separate classes for WeightingJVISAD and 
Weighting_seq). These classes are 'low', 'medium' and 'high'. Membership is 
based on whether the input comes within each of three triangular-like regions 
as shown in Figure 34. The derivation of positions of the lines defining in 
which classes particular measured values will reside is based on 
experimentation. Although the illustrated regions of the drawings are shown 
as triangular in shape, it should be noted that the regions may be shaped to 
follow any continuous function that is determined experimentally to give good 
results. The horizontal axis of the class function corresponds to the input 
value (WeightingJVISAD or Weighting_seq) and the vertical axis defines the 
degree of membership of the class. In this case, the same class membership 
diagram is used for both WeightingJVISAD and Weighting_seq, A similar 
class of membership diagram is derived for the fuzzy output 
Weighting_comp, as shown in Figure 35. In this case the diagram has five 
regions - very low, low, medium, high and very high. 

The following fuzzy rules can be applied to determine 
Weighting_comp; in these rules a logical AND is assumed between 
WeightingJVISAD and Weighting_seq; 



Rule No. WeightingJVISAD Weighting_seq Weighting_comp 

1 low low very low 

2 low medium low 

3 low high medium 

4 medium low very low 

5 medium medium medium 

6 medium high high 

7 high low low 

8 high medium high 



46 



J 



9 high high very high 

Fuzzy rules are applied to determine the truth of the rules. For 
example, assume that WeightingJVISAD and Weighting_seq are 0.35 and 0.9 
respectively. 

5 The 0.35 input results in 0.5 degree of class membership in 'Low' and 

0.5 degree of class membership in 'Medium'. The 0.9 input results in 1.0 
degree of class membership in 'High'. 

Therefore Rules 3 and 6 are true but provide different values for the 
output Weighting_comp ('medium' and 'high' respectively). The outputs that 
10 are possible for these rules are shown in Figure 36. 

Referring firstly to Rule 3, the low value of WeightingJVISAD is 
combined with a logical AND with the high value of Weighting__seq and the 
minimum value of the two expressions is taken as the truth level of Rule 3. 
The 0.5 degree of membership of 'low' for WeightingJVISAD is less than the 
15 1.0 degree of membership of class 'high' for Weighting_seq. Hence the truth 

level of the Rule 3 is 0.5. 

Referring to Rule 6, the medium value of WeightingJVISAD is 
combined with a logical AND with the high value of Weighting_seq and the 
minimum value of the two expressions is taken as the truth level of Rule 6. 
20 The 0.5 degree of membership of 'medium' for WeightingJVISAD is less than 

the 1 .0 degree of membership of class 'high' for Weighting_seq. Hence the 
truth level of the Rule 6 is 0.5. 

The 'medium' and 'high' labels for the Weightingjcomp function 
membership in Figure 36 are truncated at the truth levels defined by the 
25 fuzzy rules above. This is shown in Figure 37. 

A numerical output for Weighting_comp is derived using a centroid 
defuzzification technique. An estimate of the center of gravity of the entire 
shaded region in Figure 37 is made. In this case, the center of gravity is at 
0.625, and hence the output Weighting_comp is assigned this value. 
30 Having determined Weighting^comp, one can use the method shown 

above to determine the weighted least squares fit and to determine to what 
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extent the current motion should be based on the current motion estimate or 
on the previous motion estimate. 

Of course, it will be apparent from the foregoing discussion that the 
detected motions in the X, Y and/or Z directions are local motions, i.e. 
motions with respect to the current position and orientation of the transducer 
and its arrays. Initially, at the start of the scan, it is typically assumed at the 
local X, Y and Z directions correspond to an assumed global axis system 
which remains constant throughout the motion of the transducer. If the 
transducer is rotated about the azimuthal axis of the image plane, as it might 
during a fan-like sweep, then the local Z motion (depth direction of the 
transducer) will rotate until it contains a significant component in the global Y 
or elevation direction. With every detected motion of the transducer, the new 
position and orientation of the transducer in the global axis system are 
calculated. The orientations of the local X, Y and Z directions (i.e. azimuth, 
elevation, and range or depth of the transducer) with respect to the global 
axis system are updated. Therefore, subsequent analysis of motion in the 
local Z direction of the transducer is decomposed into components in the 
global Z and Y directions, for example. 

By way of example, consider the situation where the depth or Z 
direction of the transducer has been rotated from initially pointing down in 
alignment with the global Z direction to being angled at 45° with respect to 
the global Z direction. A motion in the local Z direction of the transducer of 
ten pixels is now decomposed into 10cos (45°) in the global Z direction plus 
10cos (45°) in the global Y direction. In this example, the local Z direction is 
still orientated perpendicularly with respect to the global X direction, and 
hence a local Z motion has no component in the global X direction. 

In general, the relation of the local axis directions with respect to the 
global axis directions can be calculated using cosines, which are 
continuously updated as the transducer is swept through the volume. 
Preferably, these direction cosines are maintained continuously for all three 
axes. 
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As used herein, the term "component of motion" is intended broadly to 
encompass translational components, rotational components, and 
combinations thereof. 

Data Overlapping Techniques 

When two regions of image data are combined to obtain an extended 
field of view as described above, a smooth interpolation scheme is preferably 
used at the boundaries of the data from different image data frames. As 
shown in Figure 38, variable weighting factors can be used to provide such 
smooth interpolation schemes. In Figure 38, the right-hand edge of the 
previous frame ends with pixel number 3 and the new portion of the frame 
begins with pixel number 4. The weighting factor used for the previous frame 
1 varies from one within the old frame at pixels 0 and 1, smoothly down to 0 
within the new portion of the frame at pixels 5, 6 and 7. Conversely, the 
weighting factor for the subsequent frame 2 varies from 0 within the old frame 
at pixels 0 and 1 gradually up to 1 for pixels 5, 6 and 7 of the new portion of 
the frame. In general, compounding can be used for accumulated image data 
in any of the embodiments described above to reduce noise in the image. 
Similarly, compounded data may be used with tracking data to reduce noise. 

Techniques for the Detection of Incorrect 
Estimates of the Component of Motion 

There are a variety of ways of using the motion estimates along the 
beam lines emanating from the tracking arrays to create a definition of the 
plane of the image array and the 3-D pixel locations for pixels on the image 
array plane. 

One approach is to fit straight lines using a least squares or weighted 
least squares technique in which motion quality is used as a weighting factor. 
Based on these lines a number of points can be identified along with their 
associated 3-D motions. For example, four points can be selected at the top 
left, bottom left, bottom right and top right portions of the region, and bi-linear 
interpolation can be used to find pixel locations. From the motion estimates 
along the lines the equation for a plane (Y = a + bX + cZ) can be fitted. The 
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quality of the fit may be measured by a least squares or weighted least 
squares technique. Then using the four key points identified previously, find 
the equation for a plane, i.e. fit three equations Y= a + bX +cZ for three points 
to find a t b, c using for example matrix inversion techniques. This step is 
repeated for a different set of three of the four key points. If the ratios a1/a2 
(where a1 and a2 are the 'a' values derived from different sets of three 
points), b1/b2, or c1/c2 exceed a threshold (either too large or too small), the 
system can be programmed to warn the user via a video output that the plane 
is skewed, and that a rescan is appropriate. 

The sum of squared errors, in either or both the line and plane case, 
may be used as a measure of low quality motion estimates and used either 
internally to adapt the motion estimate (i.e. use larger block sizes or make 
more motion estimates) or supplied to the user as a video or audible warning, 
as for example prompting a re-scan. Similarly, it is possible to accumulate 
the detected motion errors between successive motion estimates and to 
compare the cumulative motion error against a preset threshold. When the 
cumulative motion error crosses this threshold, the system is preferably 
programmed to warn the user that cumulative position error is unsatisfactory, 
and that a rescan is preferred. Optionally, the cumulative motion error (which 
may be derived from the sum of squared errors but is not necessarily exactly 
equal to the sum of squared errors) may be displayed for the user. 

Alternative 3D Viewing Techniques 

As described above, multiple 2D slices can be reconstructed into a 
solid 3D volume set. This is, of course, not the only approach that can be 
used to form the output display 46. For example, a simpler display may 
comprise a displayed reference bounding box which is 3D in form although 
displayed as a 2D projection. Using the motion detection information 
described above, the position and angular orientation of all of the planes of 
image data are calculated as before. However, in this alternative a selected 
2D slice is displayed oriented within the 3D bounding box displayed on the 
screen. This can be done using the process described in Keller, U.S. Patent 
No. 5,353,354. Techniques for projecting image data defined in 3 dimensions 
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onto a 2-day screen are well known, as described for example in chapters 5 
and 6 of Computer Graphics (Foley, et al., Addison-Wesley, 1995.) Of 
course, display of a single 2D slice within a 3D frame is a subset of the 
general 3D reconstruction and visualization system described above. 

5 Alternative Beamforming Techniques 

The embodiments described above use image data frames to collect 
data for display and tracking frames to collect data to determine relative 
motion of the transducers. Since the apertures for the image data frames and 
the tracking frames are physically separated, the collection of these frames of 

1 0 image data really form two independent beamformer tasks. If desired, 

multiple simultaneous transmit and/or receive beams can be used to reduce 
the time required to accumulate tracking data. One example of a multiple 
transmit-beam system, which could readily be adapted for simultaneously 
transmitting ultrasonic beams for the image data frames and the tracking 

15 frames is disclosed in U.S. patent application Serial No. 08/673,410, 

assigned to the assignee of the present invention. Similarly, a multiple 
receive-beam beamformer can be used to provide a separate receive beam 
for each transmit beam, thereby speeding data acquisition. The multiple 
receive-beam beamformer disclosed in U.S. patent application Serial No. 

20 08/432,615, assigned to the assignee of the present invention, can be 

adapted for this purpose. See also the multiple receive-beam beamformer 
disclosed in O'Donnell U.S. Patent 4,886,069. 

The coherent image formation techniques disclosed in U.S. Patent 
Application Nos. 08/419,595 and 08/418,640, Wright et al., "Method and 

25 Apparatus for Coherent Image Formation" (assigned to the assignee of the 

present invention) can be used advantageously with selected embodiments of 
this invention. The system of the Wright patent applications provides phase 
alignment between adjacent scan lines in the near field, and, therefore, 
provides a shift-invariant speckle pattern. Such a shift-invariant speckle 

30 pattern should provide superior image motion detection based on the speckle 

tracking than that attainable with a conventional system in which the speckle 
pattern is shift variant due to a lack of phase alignment between scan lines. 
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Very low cost scanning is possible using a frequency sweep technique 
to perform an angular scan. Consider the system shown in Figure 41 , in 
which a tracking array is provided with a plurality of transducer elements 
separated by a pitch P. Each of the transducer elements is connected via 
time delay elements to an input signal. As shown in Figure 41, in this case 
the input signal is a relatively narrow band pulse train comprising a tone burst 
5 to 10 cycles in length having a fundamental period 1/F. Thus, transducer 
element n receives the input signal shown in Figure 41 delayed by delay 
interval AT»n. The angle of the main lobe of the resulting beam is determined 
by the duration of the time delay AT and the period of the tone burst signal 
1/F, By changing the frequency of excitation F, the angle of the scan line can 
be varied, Hence, for very little cost it is possible to scan the region. Of 
course, axial resolution of the resulting beam is not optimal, since for any 
given direction the signals are narrow band and hence have a long duration. 
In principle, it is possible to transmit with a broad band pulse, and then to use 
separate band pass filters for different frequencies so as to form multiple 
beams simultaneously. In the system of Figure 41 constructive interference, 
and therefore the primary beam direction, is achieved when P»sin9 is equal to 
v/F where P, 9 and F are as shown in Figure 41 and v is the speed of sound 
in tissue. By sweeping the frequency of the input signal, and therefore the 
period 1/F, the resulting beam can be caused to sweep in angle 9, 

Another approach, as shown in Figure 42, uses a set of mutually 
delayed signals, such as four signals in the example of Figure 42. Each 
signal is a relatively narrow band tone burst, and in the example of Figure 42 
the various signals are delayed from one another by multiples of 90°. 
Typically, the length of the tone burst is related to the number of transducer 
elements and the times the signal is repeated across the array. For example, 
a 32 element array may use an eight cycle tone burst. As before, by varying 
the frequency of the input signal, the steering angle is varied. This approach 
is similar to that of Figure 41 , except that the four input signals are directly 
generated rather than time delayed with respect to one another in a 



52 



progressive fashion as shown in Figure 41 . In this case, constructive 
interference occurs at the angle 9 satisfying the following equation: 
4P*sin9 = (1/F>v, 

where v is the speed of sound in the medium as discussed above., 
5 In alternative embodiments three signals spaced at a mutual delay of 

120° may be used instead of the four-signal arrangement described above. 
However, four delay signals are often preferred for reasons of availability of 
components for producing 90° phase shifts in sinusoidal signals. This 
approach provides adequate lateral resolution at a low cost. 

10 According to the method described above, first an ultrasound 

transducer is provided comprising an imaging and a tracking array of any of 
the types described above. Then a transmit signal is provided to each 
element of the tracking array, this transmit signal having a plurality of cycles 
and a characteristic frequency. Then the frequency of the transmit signal is 

15 varied to control the scan direction. As pointed out above, the transmit 

signals may be progressively delayed versions of a single input signal or they 
may be directly generated. 

Alternative Operator Warning Messages 

If one of the tracking arrays detects motion but the other does not, this 
20 condition may be taken as an indication that the tracking array showing no 

motion is not in tissue contact. Preferably, the system controller includes 
programmed logic that responds to this condition by alerting the system 
operator with a warning message, such as an audible tone or a visual 
message on a display screen. 
25 For example, as shown in Figure 43, a transducer can include a single 

image data array 112 and three tracking arrays 114. Tracking data from the 
three tracking arrays 1 14 is processed by a receive beamformer to generate 
three sets of tracking images that are applied to a motion estimator. This 
motion estimator generates three motion estimates, each associated with a 
30 respective one of the tracking arrays 114, These three motion estimates are 

applied to a majority voting logic block, which compares the three estimates 
for a common point in time. It is anticipated that from time to time one of the 
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tracking arrays may lose contact with the body of interest. Typically, one of 
the end arrays will lose contact first If one of the tracking arrays produces a 
false motion estimate, because it is not in contact with tissue, the majority 
voting logic block determines the false motion estimate since it is in a 
5 minority. Alternatively, the quality of a motion estimate can be assessed by 

comparing the minimum sum of absolute differences to the mean some of 
absolute differences. Once an unreliable motion estimate has been isolated, 
a corrected motion estimate can be supplied which is extrapolated or 
interpolated from the motion estimates obtained with the remaining tracking 
1 0 arrays. 

Single Block Motion Estimators 

Although the overall motion between adjacent image frames can be 
estimated based on a collection of motion estimates in small regions as 
described above, it is also possible to estimate motion using a single large 

15 motion estimation block. When a collection of motion estimates is used, it is 

preferred to detect translation. A component of rotation may be inferred if the 
translations are not all similar. When a single block is used for motion 
detection, it is preferred to calculate both the components of translation and 
rotation directly from this block, In general, the axis of rotation between a 

20 reference frame and a subsequent frame may lie anywhere within the image 

plane or outside the image plane. Fortunately, modest errors in the location 
of the axis of rotation are tolerable, since, for example, a small rotation about 
an axis well outside the image frame causes a detected motion which is 
practically equivalent to a pure translation. If a single block is used for 

25 motion detection, then the following algorithm can be used: 

1 . Select a subset of the image frame pixels from a first or 
reference image frame. This subset is selected to ensure that the 
subsequent computations are manageable. If the reference frame is 400 x 
300 pixels, then a block 160 x 160 pixels may be selected, centered at the 

30 center of the reference image frame, 

2. Computational processing time limitations may make it 
preferable to use a smaller block such as a 40 x 40 or an 80 x 80 reference 
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block for the motion estimate. In this case, the 160 x 160 pixel block is 
desampled after low-pass filtering to prevent aliasing. 

« 3. A matrix of test axes of rotation is then defined, as shown, for 
example, in attached Figure 39. Preferably, the number of test axes is a§ 
large as possible, given the constraints of computation time. In some cases 
many more test axes than those shown in Figure 39 can be used. 

4. A correlation search is then performed. This search comprises 
taking the 80 x 80 reference block from the first frame and comparing it to the 
current frame and testing for the minimum sum of absolute differences 
assuming: 

(a) Rotation of the test block or the current frame about each 
of the defined test axes; 

(b) For each test axis, rotating through a predetermined set 
of rotations, for example, between -4° and +4° in two degree steps. When 
rotation is performed, it is preferred to interpolate pixel values in the rotated 
block (whether the reference or current block) so that the pixel values directly 
overlie one another. 

(c) For each test axis of step (a) and for each rotation of step 
(b), the pixels in one of the two blocks being compared are translated in both 
the X and Y axes by up to ±10 pixels. 

(d) For each test axis, each rotation, and each translation, 
the minimum sum of absolute differences is calculated between the reference 
block and the subsequent frame. The best correlation, as determined, for 
example, by the minimum sum of absolute differences, is then used to 
determine both the translation and the rotation of the subsequent frame with 
respect to the reference block. 

In this way, a single reference block can be used to determine both 
translation and rotation. Preferably, the search for the minimum sum of 
absolute differences uses the previous estimate of motion as a starting point 
for the search for the current estimate of motion. This approach reduces the 
total time required for the calculation. Experimentation can be used to 
determine the most efficient search in terms of the likely locations for the axis 
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of rotation, the likely range of rotation between successive frames, and the 
likely range of translations between successive frames. As an example, it is 
most likely that the axis of rotation will lie in the region defined in Figure 40, 
and it is most likely that rotation between successive frames will be small. 
5 Any of the foregoing embodiments can be adapted to utilize a 

selectively received harmonic component for tracking, imaging, or 
both. 

As is known in the art, harmonic imaging provides advantages 
in certain applications. In one form of harmonic imaging, ultrasonic 

10 energy concentrated near a fundamental frequency (such as 2MHz for 

example) is transmitted into a target such as a tissue of a medical 
subject. Ultrasonic echo information from the tissue is selectively 
received such that a harmonic component of the echo information is 
processed. This harmonic component is concentrated near a 

1 5 harmonic of the fundamental frequency (such as the second harmonic, 

or 4MHz in the foregoing example). Harmonic imaging has in the past 
been performed both with and without added non-linear contrast agent. 
When non-linear contrast agent is added, it often comprises micro- 
bubbles that are carried by blood, and that radiate echo information at 

20 the harmonic frequency. In tissue harmonic imaging, non-linear effects 

in the tissue distort a component of the transmitted acoustic signal, 
giving rise to harmonic (e.g., second harmonic) components not 
present in the transmitted signal. 

It has been observed that tissue harmonic images as described 

25 above provide a particularly high spatial resolution and often possess 

improved contrast resolution characteristics. In particular, there is 
often less clutter in the near field. Additionally, because the transmit 
beam is generated using the fundamental frequency, the transmit 
beam profile is less distorted by a specific level of tissue-related phase 

30 aberration than would a transmit beam formed using signals 

transmitted directly at the second harmonic. 

In order to enhance the harmonic image, it is preferred to shape 
the transmitted signal in the frequency domain such that substantially 
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no harmonic energy is transmitted. This can be done using a suitably 
programmed transmit beamformer as described in U.S. Patent 
application Serial No. 08/771,345, filed December 16, 1996 and 
assigned to the assignee of the present invention, or a suitably filtered 
5 transmit beamformer as described in U.S. Patent application Serial 

Nos. , filed July 15, 1997 (Attorney Docket Nos. 

5050/21 8 5 5050/219, 5050/220 and 5050/221). 

Many techniques are available for selectively receiving the 
harmonic component of the ultrasonic echo information. For example, 

10 a filter may be included in the receive signal processing path to block 

the transmitted fundamental component and to pass the desired 
harmonic component. This filter may be a time varying filter of the type 
described by Green, U.S. Patent 4,016,750. Alternately a fixed, low 
pass filter may be used on a demodulated signal, wherein the 

15 demodulation carrier signal is selected to place the lower side band of 

the mixed signals such that what was the harmonic component in the 
RF domain now lies within the pass band of the fixed pass band or low 
pass filter. The mixed frequency may be at base band (centered at 
0Hz) or at some intermediate frequency (such as 2MHz). 

20 Harmonic imaging techniques can for example be used in the 

embodiment of Figure 22. In this case, the transmit beamformer 15 
produces shaped transmit signals for the transducer arrays 1 8, 20, 22. 
These shaped transmit signals concentrate the transmitted ultrasonic 
energy near the fundamental frequency f 0 , while substantially blocking 

25 transmitted ultrasonic energy near the harmonic (e.g., 2f 0 ). 

Received signals from the transducer arrays 18, 10, 22 are 
filtered as explained above by the filter 13' included in the image data 
signal path and by the filter 13" in the tracking data signal path. The 
filters 13', 13" may be bandpass, low pass, or high pass filters. 

30 In one embodiment the filter 13" is selected to pass the second 

harmonic component of the received signal and to block the 
fundamental component. Using the harmonic signal for the purpose of 
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generating tracking information has the advantage that higher 
resolution and better contrast data is provided, and hence more 
accurate and reliable estimates of transducer motion are obtained. 
Tracking information may include modulated RF data or demodulated 
5 (e.g. I/Q) data, either before or after scan conversion. During tissue 

harmonic imaging, the target is maintained free of additional non-linear 
contrast agent throughout an entire medical ultrasound examination 
session that includes acquisition of the image data sets and the 
tracking data sets described above. 

10 In another embodiment, the filter 13' is selected to pass the 

harmonic component and to block the fundamental component of the 
received signal such that the image data sets are created as a function 
of the harmonic component. By employing harmonic signals for 
generating image data sets a higher quality image is obtained for 

15 display, as for example in a 3-D volume image data set. 

Many variations are possible. For example, it is possible to use 
the harmonic component in the near field and the fundamental 
component in the far field where penetration of the harmonic 
component is inadequate. This approach is discussed in detail in U.S. 

20 Patent Application Serial No. (Attorney Docket 

5050/227), assigned to the assignee of the present invention, and is 
applicable to both the image data sets and the tracking data sets. As 
another example, a combination of fundamental and harmonic 
components (e.g. average values) for either or both the tracking and 

25 image data is used. Additionally, the harmonic component of the 

received signal may be used for both the image data sets and the 
tracking data sets. In some cases, it is preferred to use harmonic 
components of different bandwidths for the two types of data sets; for 
example a narrower bandwidth may be used for tracking data and a 

30 wider bandwidth may be used for image data. 

The harmonic component acquired by the image data array 18 
may also be used for registering separate frames of image data to form 
an extended view, using the techniques described above. The 




harmonic component may be used either for the image tracking 
function or the image display function, depending upon the application. 
As an example, when the extended image includes data collected at a 
far-field range, it may be preferable to use the fundamental component 
5 of the received ultrasound information for the image data sets, since 

the fundamental component is characterized by a greater penetration 
depth. Since it is not necessary to perform image tracking at all 
depths (it may be adequate to calculate image motion in the near field 
only), it may be preferred to use the harmonic component for the 

1 0 image tracking function since the harmonic component has a higher 

spatial resolution and a higher contrast resolution and the comparison 
is being performed in the near field where penetration is not an issue. 
Other combinations of harmonic and fundamental components for the 
various combinations of tracking and image formation can be made, 

15 including the use of a combination (e.g. a sum) of fundamental and 

harmonic components for tracking or image formation, 

As mentioned above, there is an advantage in making multiple 
motion estimates and accumulating these such that those with the 
greatest quality or certainty are emphasized. Multiple motion 

20 estimates may be made using fundamental and harmonic data and the 

results combined. In the very simplest case independently obtained 
motion estimates based on different frequency components of the 
received signal are simply averaged to obtain a final motion estimate. 

Conclusion 

25 The systems and methods described above provide a number of 

important advantages. They are insensitive to the electromagnetic 
environment and to patient motion, in contrast to magnetic orientation 
methods. The present invention is potentially implemented at lower cost than 
magnetic methods, and lower specification transducer arrays can be used, 

30 Potentially, the techniques described above can provide excellent accuracy 

of registration, since accuracy is determined by imaging resolution which 
scales with frequency. 
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Depending upon the application, the improved transducers described 
above may require more or larger cables, and the footprint of the transducer 
may be slightly extended. However, these potential problems may be 
minimized by using the techniques described above. 

Of course, it is intended that the foregoing detailed description be 
regarded as an illustration of presently preferred forms of the invention, 
rather than as a limitation. It is the following claims, including all equivalents, 
which are intended to define the invention. 
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Claims 

1 . An ultrasonic transducer comprising: 
a support element; 

a first transducer array coupled to move with the support 
element and comprising a plurality of first transducer elements arranged 
along an azimuthal axis, said first transducer array comprising first and 
second ends spaced along the azimuthal axis and a first central image plane; 

a second transducer array coupled to move with the support 
element and comprising a plurality of second transducer elements, said 
transducer array positioned near the first end of the first transducer array and 
comprising a second central image plane; and 

a third transducer array coupled to move with the support 
element and comprising a plurality of third transducer elements, said third 
transducer array positioned near the second end of the first transducer array 
and comprising a third central image plane; 

said first and second central image planes being non-parallel, 
and said first and third central image planes being non-parallel, 

2. The invention of Claim 1 wherein the first and second central 
image planes are substantially orthogonal, and wherein the first and third 
central image planes are substantially orthogonal. 

3. The invention of Claim 1 wherein the second and third 
transducer arrays are substantially shorter in length along the respective 
axes than is the first transducer array, 

4. The invention of Claim 1 wherein the second and third 
transducer arrays each include substantially fewer of the respective 
transducer elements than does the first transducer array. 

5. The invention of Claim 1 wherein the first, second and third 
transducer elements are each spaced with a respective pitch, and wherein 
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the pitch of the second transducer elements is a first integer multiple of the 
pitch of the first transducer elements. 

6. The invention of Claim 5 wherein the pitch of the third 
transducer elements is a second integer multiple of the pitch of the first 
transducer elements. 

7. The invention of Claim 6 wherein the first integer multiple is 
equal to the second integer multiple. 

8. The invention of Claim 1 further comprising 

a transmit beamformer and a receive beamformer coupled to 
the first, second and third transducer arrays, 

9. The invention of Claim 8 wherein the transmit beamformer forms 
multiple simultaneous transmit beams. 

10. The invention of Claim 8 wherein the receive beamformer forms 
multiple simultaneous receive beams. 

1 1 . The invention of Claim 8 wherein the transmit beamformer 
operates the first and second transducer arrays at different ultrasonic 
frequencies. 

12. The invention of Claim 8 wherein the transmit beamformer 
operates the first, second, and third transducer arrays at a common ultrasonic 
frequency, 

13. The invention of Claim 8 wherein the transmit beamformer 
operates the second and third transducer arrays with fewer scan lines than 
the first transducer array. 
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14. The invention of Claim 8 wherein the transmit and receive 
beamformers acquire concurrent images from the first, second and third 
transducer arrays for display. 

15. The invention of Claim 8 wherein the transmit beamformer 
5 operates the second and third transducer arrays to acquire a plurality of 

frames from at least one of the second and third transducer arrays between 
adjacent frames from the first transducer array, 

16. The invention of Claim 8 wherein the transmit beamformer 
operates the first transducer array to acquire a plurality of frames from the 

10 first transducer array between adjacent frames from the second transducer 

array. 

1 7. The invention of Claim 1 4 further comprising a display system 
coupled to the beamformers to display the concurrent images from the first, 
second and third transducer arrays. 

15 18. The invention of Claim 1 further comprising an absolute sensor 

for at least one of displacement and orientation, said absolute sensor coupled 
to move with the support element. 

19. The invention of Claim 18 wherein the absolute sensor 
comprises a magnetic sensor. 

20 20. The invention of Claim 1 wherein at least a portion of the 

second transducer elements are connected in parallel with at least a portion 
of the first transducer elements, and wherein the portion of the second 
transducer elements are in a jumbled order with respect to the portion of the 
first transducer elements. 
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21 . The invention of Claim 1 wherein at least two of the first, second 
and third transducer arrays form crossed arrays. 
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22. The invention of Claim 1 wherein the second and third 
transducer arrays are positioned alongside of and laterally spaced from the 
first transducer array. 

23. The invention of Claim 1 further comprising third and fourth 
transducer arrays coupled to move with the support element and positioned 
near respective ends of the first transducer array, said third and fourth 
transducer arrays comprising respective fourth and fifth image planes 
oriented non-parallel to the first image plane. 

24. A method for registering ultrasonic image information 
acquired from a target, said method comprising the following steps: 

(a) acquiring a plurality of sets of image information 
with at least one ultrasonic transducer array, said at least one array 
moved between at least some of the sets of image information, said 
plurality of sets comprising a plurality of image data sets and a plurality 
of tracking sets; 

(b) automatically determining a component of motion 
based on a comparison of at least a portion of the tracking sets 
acquired in step (a); and 

(c) automatically using the component of motion 
determined in step (b) to register selected ones of the image data sets 
acquired in step (a). 

25. The invention of Claim 24 wherein the at least one ultrasonic 
transducer array comprises an imaging array and at least one tracking array, 
wherein the imaging array defines an image plane, wherein the tracking array 
defines a tracking plane, and wherein the image plane is oriented at a non- 
zero angle with respect to the tracking plane. 

26. The invention of Claim 24 wherein the sets of image information 
are oriented substantially parallel to one another, and wherein step (c) forms 
an extended field of view. 
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27. The invention of Claim 24 wherein at least some of the tracking 
sets do not intersect at least some of the image data sets, 

28. The invention of Claim 24 wherein step (b) comprises the step 
of cross-correlating said at least a portion of the tracking sets. 

5 29. The method of Claim 25 wherein the at least one tracking array 

comprises first and second tracking arrays, each positioned adjacent a 
respective end of the imaging array to acquire tracking sets in respective first 
and second tracking planes, and wherein step (b) determines the component 
of motion in both said first and second tracking planes. 

10 30. The method of Claim 24 wherein the image data sets comprise 

information selected from the group consisting of B-mode information, color 
Doppler velocity information, color Doppler energy information, and 
combinations thereof. 

31 . The method of Claim 24 comprising the further step of 
15 determining a second component of motion based on a comparison of at least 

some of the selected image data sets, and wherein step (c) comprises the 
step of using the second component of motion to register said image data 
sets. 



32. The method of Claim 24 wherein the image data sets are 

20 acquired using a different frequency than that used in acquiring the tracking 

sets. 

33. The method of Claim 24 wherein step (a) comprises the step of 
using dual beamformers to simultaneously acquire the image data sets and 
the tracking sets. 
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34. The method of Claim 33 wherein step (a) comprises the step of 
using respective bandpass filtering in association with the respective 
beamformers. 
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35. The method of Claim 24 wherein step (a) provides the tracking 
sets as scan-converted data. 

36. The method of Claim 24 wherein step (a) provides the tracking 
sets as acoustic line data, prior to scan conversion, 

37. The method of Claim 24 wherein step (b) performs the 
comparison using every Nth pixel of the tracking sets, where N is an integer 
greater than zero. 

38. The method of Claim 24 wherein step (b) comprises the step of 
combining a plurality of measures of the component of motion. 

39. The method of Claim 38 wherein the step of combining 
comprises the step of assigning weights to individual measures of the 
component of motion, each weight indicative of quality of the respective 
measure. 

40. The method of Claim 39 wherein the step of assigning weights 
comprises the step of comparing spatially adjacent measures of the 
component of motion, 

41 . The method of Claim 39 wherein the step of assigning weights 
comprises the step of comparing successive measures of the component of 
motion. 

42. The method of Claim 39 wherein the step of assigning weights 
uses fuzzy logic. 

43. The method of Claim 38 wherein the combining step comprises 
the step of discarding low-quality measures of the component of motion. 
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44. The method of Claim 24 further comprising the step of; 

(d) indicating to an operator when the component of motion 
determined in step (b) is outside a preferred range of values. 

45. The method of Claim 24 further comprising the step of: 

(d) alerting an operator when the determining step (b) is not 
operating effectively. 

46. The method of Claim 25 wherein step (a) comprises the step of 
operating the imaging and tracking arrays in parallel. 

47. The method of Claim 46 wherein step (a) comprises the step of 
operating the imaging and tracking arrays at differing voltage levels, 

48. The method of Claim 24 further comprising the step of: 
(d) interpolating between a plurality of measures of the 

component of motion determined in step (b). 

49. The method of Claim 24 wherein the sets of image information 
are acquired in step (a) using a plurality of separate frequencies, 

50. The method of Claim 24 wherein the sets of image information 
are acquired in step (a) using a plurality of different bandwidths. 

51 . The method of Claim 24 wherein the tracking sets comprise sets 
acquired using a plurality of different ultrasonic frequencies. 

52. The method of Claim 24 wherein the tracking sets comprise sets 
acquired using a plurality of different ultrasonic bandwidths. 

53. The method of Claim 24 wherein step (b) comprises the step of 
generating curve-fitted values derived from a plurality of measures of the 
component of motion. 
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54. The method of Claim 24 wherein step (b) comprises the step of 
adaptively varying a time interval between time of acquisition of the tracking 
sets used in determining the component of motion to cause the component of 
motion to approach a selected range. 

55. The invention of Claim 24 wherein step (b) comprises the step 
of averaging a plurality of pixels of at least one of the tracking sets prior to 
determining the component of motion. 

56. The method of Claim 24 further comprising the step of 
automatically varying intensity mapping of the tracking sets acquired in step 
(a) to enhance motion detection. 

57. The invention of Claim 24 further comprising the step of: 

(d) filtering at least said portion of the tracking sets of image 
information prior to the comparison of step (b). 

58. The method of Claim 24 wherein step (b) comprises the step of 
repeatedly using a first one of the tracking sets of image information as a 
reference in a plurality of successive ones of the comparison of step (b) until 
the component of motion is determined with respect to said first tracking set 
of image information. 

59. The method of Claim 24 wherein step (b) comprises the step of 
performing the comparison over a search region of the tracking sets of image 
information, wherein the search region is elongated in shape in a direction 
substantially aligned with the component of motion. 

60. The method of Claim 24 wherein step (b) comprises the step of 
performing the comparison over a variable search region of the tracking set. 

61 . The method of Claim 60 wherein step (b) comprises the step of 
positioning the variable search region based on a previously-determined 
component of motion. 
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62. The method of Claim 60 wherein step (b) comprises the step of 
sizing the variable search region based on variability of a plurality of 
previously-determined components of motion. 

63. The method of Claim 24 wherein step (b) comprises the step of 
performing a series of comparisons of the tracking sets, wherein the 
comparisons differ in resolution in at least one of spatial and signal level 
resolution. 

64. The method of Claim 24 wherein step (b) comprises the step of 
correlating two non-parallel lines of image information included in two of the 
tracking sets of image information acquired in step (a) to determine vector 
components of the component of motion, said vector components aligned 
with said lines. 

65. The method of Claim 24 further comprising the step of 

(d) forming data-compressed versions of at least some of the 
image data sets and tracking sets acquired in step (a) prior to at least one of 
steps (b) and (c). 

66. The method of Claim 65 further comprising the step of 

(e) applying data decompression to the data-compressed 
versions of step (d) prior to at least one of steps (b) and (c). 

67. The method of Claim 25 further comprising the step of (d) using 
the registered image data sets to form a 2D image in a plane obliquely 
oriented with respect to the image plane. 

68. The method of Claim 24 wherein step (b) comprises the step of 
utilizing in the comparison only the tracking sets that correspond to selected 
portions of a cycle selected from the group consisting of an ECG cycle and a 
breathing cycle. 
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69. The method of Claim 24 wherein the information of the tracking 
sets used in the comparison of step (b) is selected from the group consisting 
of envelope-detected data prior to scan conversion, RF beamformer signals 
prior to envelope detection, and baseband beamformer signals prior to , 
envelope detection. 

70. The method of Claim 24 wherein the image data sets are 
acquired using a different frequency than that used in acquiring the tracking 
sets, 

71 . The method of Claim 24 wherein the image data sets are 
acquired using a different bandwidth than that used in acquiring the tracking 
sets. 

72. The method of Claim 24 wherein the image data sets are 
acquired using a different azimuthal focus than that used in acquiring the 
tracking sets. 

73. The method of Claim 24 wherein step (a) further comprises the 
step of using a different logarithmic compression of signal level for the image 
data sets than for the tracking sets. 

74. The method of Claim 26 wherein the at least one transducer 
array comprises a first transducer array and at least one additional 
transducer array, wherein the image data sets are acquired using the first 
transducer array, and wherein the tracking sets are acquired using the at 
least one additional transducer array. 

75. The method of Claim 74 wherein the first and at least one 
additional transducer arrays are co-linear and axially spaced from one 
another. 
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76. The method of Claim 74 wherein the first and at least one 
additional transducer arrays are positioned alongside of and laterally spaced 
from one another. 

77. The method of Claim 24 wherein step (a) further comprises the 
step of automatically varying intensity mapping of the tracking sets to 
enhance motion detection. 

78. The method of Claim 24 wherein the image data sets and the 
tracking sets are acquired using different transducer arrays, 

79. The method of Claim 78 wherein the acquiring step comprises 
the step of multiplexing signals to the different transducer arrays via a 
common set of signal conductors. 

80. The method of Claim 24 wherein the image data and tracking 
sets each comprise a plurality of scan lines, and wherein sets of one or more 
scan lines of the image data sets are interleaved in time with sets of one or 
more scan lines of the tracking sets. 

81 . The method of Claim 24 wherein step (a) comprises the step of 
forming multiple simultaneous transmit beams with the at least one 
transducer array. 

82. The method of Claim 24 wherein step (a) comprises the step of 
forming multiple simultaneous receive beams with the at least one transducer 
array. 

83. The method of Claim 24 wherein step (a) comprises the step of 
coherently forming at least the tracking sets. 

84. The method of Claim 24 further comprising the step of (d) 
indicating to an operator when tissue contact is lost for a transducer array 
included in the at least one transducer array. 



71 



85. The method of Claim 24 wherein the selected ones of the image 
data sets comprise consecutively acquired image frames. 

86. The method of Claim 24 wherein the selected ones of the image 
data sets comprise non-consecutively acquired image frames separated in 
time by at least one intervening image frame. 

87. The method of Claim 24 wherein step (c) comprises the step of 
smoothly interpolating between the image data sets at a boundary between 
the selected image data sets. 

88. A method for forming an extended field of view of a target, said 
method comprising the following steps: 

(a) acquiring a plurality of sets of image information with an 
ultrasonic transducer array, said array moved substantially in an image plane 
between sets of image information; 

(b) automatically determining rotational and translational 
components of motion in the image plane based on a plurality of comparisons 
of a single block of image information from a first one of said sets with a 
second one of said sets; and 

(c) automatically using the components of motion 
determined in step (b) to register said first and second sets to form an 
extended field of view. 

89. An ultrasonic transducer comprising: 
a support element; 

a first transducer array coupled to move with the support 
element and comprising a plurality of first transducer elements arranged 
along an azimuthal axis, said first transducer array comprising first and 
second ends spaced along the azimuthal axis and a first central image plane; 

a pair of second single-element transducer elements positioned 
on respective sides near the first end of the first transducer array; 
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a pair of third single-element transducer elements positioned on 
respective sides near the second end of the first transducer array. 

90. The invention of Claim 89 wherein at least some of the second 
and third single-element transducer elements comprise respective elongated 
elements oriented to extend substantially parallel to the azimuthal axis. 

91 . The invention of Claim 89 wherein at least some of the second 
and third single-element transducer elements comprise respective circular 
elements. 

92. The invention of Claim 91 wherein at least some of the second 
and third single-element transducer elements are pointed in separate 
directions. 

93. The invention of Claim 89 wherein at least some of the second 
and third single-element transducer elements are focused at a selected 
range. 

94. The invention of Claim 89 wherein at least one of the second 
and third single-element transducer elements is superimposed on the first 
transducer array. 

95. An ultrasonic transducer comprising: 
a support element; 

a first transducer array coupled to move with the support 
element and comprising a plurality of first transducer elements arranged 
along an azimuthal axis, said first transducer array comprising first and 
second ends spaced along the azimuthal axis and a first central image plane; 

a second transducer array coupled to move with the support 
element and comprising a plurality of second, annular transducer elements 
positioned near the first end of the first transducer array; 

a third transducer array coupled to move with the support 
element and comprising a plurality of third, annular transducer elements 
positioned near the second end of the first transducer array. 



96. The invention of Claim 95 further comprising: 

a fourth transducer array coupled to move with the support 
element and comprising a plurality of fourth, annular transducer elements 
positioned near the first end of the first transducer array; and 

a fifth transducer array coupled to move with the support 
element and comprising a plurality of fifth, annular transducer elements 
positioned near the second end of the second transducer array. 

97. The invention of Claim 95 wherein at least one of the second 
and third transducer arrays is superimposed on the first transducer array. 

98. The invention of Claim 96 wherein the second and fourth 
transducer arrays are pointed in separate directions and wherein the third 
and fifth transducer arrays are pointed in separate directions. 

99. A method for creating an ultrasonic scan comprising the 
following steps: 

(a) providing an ultrasonic transducer comprising an imaging 
transducer array and a tracking transducer array, said tracking transducer 
array comprising a plurality of transducer elements; 

(b) applying a respective transmit signal to each of the 
transducer elements, each transmit signal comprising a plurality of cycles 
characterized by a frequency; and 

(c) varying the frequency to selectively control an associated 
ultrasonic scan direction. 

1 00. The method of Claim 99 further comprising the step of (d) using 
tracking data from the tracking transducer array to align image data from the 
imaging transducer array in three dimensions. 

1 01 . The invention of Claim 99 wherein step (b) comprises the step 
of generating the transmit signals by progressively delaying an input signal 
such that each of the transmit signals is delayed by a time period equal to 
AT»n with respect to the input signal, where n is a non-negative integer. 
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1 02. The invention of Claim 99 wherein step (b) comprises the step 
of directly generating the transmit signals. 

1 03. The invention of Claim 99 wherein each transmit signal 
comprises a respective tone burst. 

104. The invention of Claim 102 wherein each tone burst is 5 to 10 
cycles in length. 

1 05. A method for detecting an erroneous motion estimate 
comprising the following steps: 

(a) providing an ultrasonic transducer comprising an imaging 
transducer array and at least three tracking transducer arrays, each tracking 
transducer array comprising at least one transducer element; 

(b) collecting tracking data from each of the tracking 
transducer arrays; 

(c) developing at least three motion estimates from the 
tracking data, each motion estimate associated with a respective tracking 
transducer array; and 

(d) detecting an unreliable one of the motion estimates 
based on a comparison of the motion estimates. 

1 06. A method for registering ultrasonic image information 
acquired from a target, said method comprising the following steps: 

(a) acquiring a plurality of sets of image information 
with at least one ultrasonic transducer array, said at least one array 
moved between at least some of the sets of image information, said 
plurality of sets comprising a plurality of image data sets and a plurality 
of tracking sets; 

(b) automatically determining a component of motion 
based on a comparison of at least a portion of the tracking sets 
acquired in step (a); and 

(c) automatically using the component of motion 
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determined in step (b) to register selected ones of the image data sets 
acquired in step (a); 

wherein step (a) comprises the step of transmitting 
ultrasonic energy concentrated near a fundamental frequency into a 
target; and 

wherein at least one of the image data sets and the 
tracking data sets comprises a selectively received harmonic 
component of received ultrasonic echo information, said harmonic 
component concentrated near a harmonic of the fundamental 
frequency, 

107. The method of Claim 106 wherein the image data sets 
comprise the selectively received harmonic component. 

108. The method of claim 106 wherein the tracking data sets 
comprise the selectively received harmonic component, 

1 09. The method of Claim 1 06 wherein the image data sets 
and the tracking data sets both comprise the selectively received 
harmonic component. 

110. The method of Claim 1 07 wherein the tracking data sets 
comprise a second selectively received harmonic component of 
received ultrasonic echo information. 

111. The method of Claim 110 wherein the first-mentioned 
and second selectively received harmonic components differ in 
bandwidth. 

1 1 2. The method of Claim 1 06 wherein steps (a)-(c) are 
performed during a medical ultrasound examination session, and 
wherein the method comprises the further step of (d) maintaining the 
target free of additional non-linear contrast agent throughout the entire 
medical ultrasound examination session. 



113. A method for forming an extended field of view of a 
target, said method comprising the following steps: 

(a) acquiring a plurality of sets of image information 
witfvan ultrasonic transducer array, said array moved substantially in 
an image plane between sets of image information; 

(b) automatically determining components of motion in 
the image plane based on a plurality of comparisons of a single block 
of image information from a first one of said sets with a second one of 
said sets; and 

(c) automatically using the components of motion 
determined in step (b) to register said first and second sets to form an 
extended field of view; 

wherein step (a) comprises the step of transmitting 
ultrasonic energy concentrated near a fundamental frequency into a 
target; 

wherein at least some of the sets of image information 
comprise a selectively received harmonic component of received 
ultrasonic echo information, said harmonic component concentrated 
near a harmonic of the fundamental frequency. 

1 1 4. The method of Claim 1 1 3 wherein steps (a)-(c) are 
performed during a medical ultrasound examination session, and 
wherein the method comprises the further step of (d) maintaining the 
target free of additional non-linear contrast agent throughout the entire 
medical ultrasound examination session. 

1 1 5. The method of Claim 1 1 3 wherein the components of 
motion comprise rotational and translational components of motions. 
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ABSTRACT OF THE DISCLOSURE 

An ultrasonic imaging system includes an ultrasonic transducer having 
an image data array and a tracking array at each end of the image data array. 
The tracking arrays are oriented transversely to the image data array, 
5 images from the image data array are used to reconstruct a three- 

dimensional representation of the target. The relative movement between 
respective frames of the image data is automatically estimated by a motion 
estimator, based on frames of data from the tracking arrays. As the 
transducer is rotated about the azimuthal axis of the image data array, 
1 0 features of the target remain within the image planes of the tracking arrays. 

Movements of these features in the image planes of the tracking arrays are 
used to estimate motion as required for the three-dimensional reconstruction. 
Similar techniques estimate motion within the plane of an image to create an 
extended field of view. 
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jj^ xARATION FOR PATENT APPLICATkJk 

As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint inventor (if 
plural names are listed below) of the subject matter which is claimed and for which a patent is sought on the invention entitled 
Multiple Ultrasound Image Registration System, Method and Transducer, the specification of which: 

is attached hereto. 

EI was filed on August 22. 1997 as Application Serial No. 08/916.585 . 

{~1 and was amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims as 
amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the patentability as defined in Title 37, Code of Federal 
Regulations, § 1.56(a). 

I hereby claim foreign priority benefits under 35 U.S.C. § 119(a)-(d) or § 365(b) of any foreign applications) for patent or 
inventor's certificate or § 365(a) of any PCT International application which designated at least one country other than the 
United States, listed below and have also identified below, by checking the box, any foreign application for patent or inventor's 
certificate, or PCT International application having a filing date before that of the application on which priority is claimed: 

Prior Foreign Application^) Priority Claimed 

jD □ □ 

yp (Number) (Country) (Day/Month/Year Filed) Yes No 

IJiereby claim the benefit under 35 U.S.C. § 1 19(e) of any United States provisional application^) listed below: 

^ 60/012,578 February 29, 1996 

gj (Application Serial No.) (Filing Date) 

Miereby claim the benefit under 35 U.S.C. § 120 of any United States application^), or § 365(c) of any PCT International 
implication designating the United States, listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT International application in the manner provided by the first 
Uragraph of 35 U.S.C. § 112, 1 acknowledge the duty to disclose information which is material to patentability as defined in 
35 CFR § 1.56 which became available between the filing date of the prior application and the national or PCT International 
piling date of this application: 

5 08/621,561 March 25, 1996 Pending 



;ff (Application Serial No.) (Filing Date) (Status-patented, pending, abandoned) 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information 
and belief are believed to be true; and farther that these statements were made with the knowledge that willful false statements 
and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code 
and that such willful false statements may jeopardize the validity of the application or any patent issued thereoc 



Inventor's Signature 

Full name of sole or first inventor John A Hossack 



irdize tne validity or tne application or any patent issued thereon. 
<MU. Date: l"Fd**J ffl 



Residence Palo Alto, California 



Citizenship United Kingdom 



Post Office Address 144 Emerson Street #E, Palo Alto, California 94301 




\^Sliwa, Jr. ~ / / ^ 
fttos, California 



Inventor's Signature v _Date: F^~6 3 1 ? 

Full name of second joint inventor, if < 



Residence 
Citizenship 

Post Office Address 897 Madonna Way, Los Altos, California 94024 



BRINKS HOFER G1LSON &LIONE 
P.O. Box 10395 
Chicago, EL 606 10 
(312)321-4200 
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Full name of third joint inventor 

Residence 

Citizenship 

Post Office Address 
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Full name of fourth joint inventor 

Residence 

Citizenship 

Post Office Address 

Inventor's Signature 

Full name of fifth joint inventor 

Residence 

Citizenship 

Post Office Address 

Inventor's Signature 

Full name of sixth joint inventor 

Re^lence 

Ci^enship 

PoStOffice Address 



Samuel H. Maslak 

Woodside, California 



Date: 
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Edward A. Gardner 



Date: 



San Jose, California 



U.S.A. 



3139 Shriver Driver, San Jose, California 95132 




Date: 



Gregory^ Holley 



Mountain View, California 



U.S.A. 



12S5 Montecito Avenue #23, Mountain View, California 94043 



David J. Napolitano / 



Menlo Park, California 




Date: 



U.S.A. 



965 Menlo Avenue, Menlo Park, California 94025 
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